May 27 20:10:06.878637 ip-10-0-129-19 systemd[1]: Starting Kubernetes Kubelet...
May 27 20:10:07.379341 ip-10-0-129-19 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 20:10:07.379341 ip-10-0-129-19 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 20:10:07.379341 ip-10-0-129-19 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 20:10:07.379341 ip-10-0-129-19 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 20:10:07.379341 ip-10-0-129-19 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 20:10:07.382148 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.382085    2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 20:10:07.386618 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386598    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 20:10:07.386618 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386615    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 20:10:07.386618 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386619    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 20:10:07.386618 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386623    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386627    2565 feature_gate.go:328] unrecognized feature gate: Example
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386630    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386633    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386636    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386638    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386641    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386643    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386646    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386648    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386651    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386653    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386655    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386659    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386661    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386664    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386666    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386668    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386672    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 20:10:07.386762 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386676    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386679    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386681    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386683    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386686    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386689    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386691    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386693    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386696    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386698    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386701    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386704    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386706    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386709    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386711    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386714    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386717    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386720    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386722    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 20:10:07.387235 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386725    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386727    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386730    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386733    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386735    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386737    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386740    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386742    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386744    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386747    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386749    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386751    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386754    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386756    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386759    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386761    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386765    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386769    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386772    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386775    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 20:10:07.387697 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386778    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386780    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386784    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386786    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386788    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386791    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386793    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386796    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386799    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386802    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386804    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386807    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386809    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386812    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386814    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386816    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386818    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386824    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386826    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386829    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 20:10:07.388169 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386831    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386834    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386836    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386839    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.386841    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388027    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388034    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388037    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388040    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388044    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388046    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388049    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388052    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388054    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388057    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388059    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388062    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388064    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388066    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388069    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 20:10:07.388645 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388072    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388074    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388077    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388079    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388082    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388084    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388087    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388091    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388094    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388097    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388100    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388102    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388104    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388107    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388109    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388111    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388114    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388117    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388119    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 20:10:07.389100 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388122    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388125    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388127    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388129    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388132    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388134    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388137    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388139    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388142    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388144    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388146    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388149    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388151    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388154    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388157    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388159    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388161    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388164    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388166    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388169    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 20:10:07.389612 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388172    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388174    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388177    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388180    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388183    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388185    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388188    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388192    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388195    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388199    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388202    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388205    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388208    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388210    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388213    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388215    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388218    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388221    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388223    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 20:10:07.390073 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388225    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388228    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388231    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388233    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388236    2565 feature_gate.go:328] unrecognized feature gate: Example
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388239    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388242    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388245    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388247    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388250    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388252    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388255    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.388257    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388919    2565 flags.go:64] FLAG: --address="0.0.0.0"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388929    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388941    2565 flags.go:64] FLAG: --anonymous-auth="true"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388945    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388949    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388953    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388956    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388960    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 20:10:07.390531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388963    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388966    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388970    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388973    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388976    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388979    2565 flags.go:64] FLAG: --cgroup-root=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388981    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388984    2565 flags.go:64] FLAG: --client-ca-file=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388987    2565 flags.go:64] FLAG: --cloud-config=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388990    2565 flags.go:64] FLAG: --cloud-provider="external"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388993    2565 flags.go:64] FLAG: --cluster-dns="[]"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388996    2565 flags.go:64] FLAG: --cluster-domain=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.388999    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389002    2565 flags.go:64] FLAG: --config-dir=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389004    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389007    2565 flags.go:64] FLAG: --container-log-max-files="5"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389011    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389014    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389017    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389020    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389023    2565 flags.go:64] FLAG: --contention-profiling="false"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389025    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389028    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389031    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389033    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 20:10:07.391019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389037    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389040    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389043    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389046    2565 flags.go:64] FLAG: --enable-load-reader="false"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389054    2565 flags.go:64] FLAG: --enable-server="true"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389057    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389064    2565 flags.go:64] FLAG: --event-burst="100"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389067    2565 flags.go:64] FLAG: --event-qps="50"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389070    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389073    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389076    2565 flags.go:64] FLAG: --eviction-hard=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389080    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389082    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389085    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389088    2565 flags.go:64] FLAG: --eviction-soft=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389091    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389094    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389097    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389100    2565 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389102    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389105    2565 flags.go:64] FLAG: --fail-swap-on="true"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389108    2565 flags.go:64] FLAG: --feature-gates=""
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389112    2565 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389115    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389118    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 20:10:07.391610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389120    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389123    2565 flags.go:64] FLAG: --healthz-port="10248"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389126    2565 flags.go:64] FLAG: --help="false"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389129    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-19.ec2.internal"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389131    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389134    2565 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389137    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389140    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389143    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389146    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389149    2565 flags.go:64] FLAG: --image-service-endpoint=""
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389151    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389160    2565 flags.go:64] FLAG: --kube-api-burst="100"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389163    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389166    2565 flags.go:64] FLAG: --kube-api-qps="50"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389169    2565 flags.go:64] FLAG: --kube-reserved=""
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389172    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389175    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389178    2565 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389181    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389183    2565 flags.go:64] FLAG: --lock-file=""
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389186    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389189    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389192    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 20:10:07.392186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389201    2565 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389203    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389206    2565 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389209    2565 flags.go:64] FLAG: --logging-format="text"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389211    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389215    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389217    2565 flags.go:64] FLAG: --manifest-url=""
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389220    2565 flags.go:64] FLAG: --manifest-url-header=""
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389224    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389227    2565 flags.go:64] FLAG: --max-open-files="1000000"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389231    2565 flags.go:64] FLAG: --max-pods="110"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389234    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389236    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389239    2565 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389242    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389244    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389247    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389250    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389257    2565 flags.go:64] FLAG: --node-status-max-images="50"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389260    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389263    2565 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389266    2565 flags.go:64] FLAG: --pod-cidr=""
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389269    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 20:10:07.392752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389275    2565 flags.go:64] FLAG: --pod-manifest-path=""
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389277    2565 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389280    2565 flags.go:64] FLAG: --pods-per-core="0"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389283    2565 flags.go:64] FLAG: --port="10250"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389286    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389289    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e99173ee1cd63a8c"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389292    2565 flags.go:64] FLAG: --qos-reserved=""
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389294    2565 flags.go:64] FLAG: --read-only-port="10255"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389297    2565 flags.go:64] FLAG: --register-node="true"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389300    2565 flags.go:64] FLAG: --register-schedulable="true"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389303    2565 flags.go:64] FLAG: --register-with-taints=""
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389306    2565 flags.go:64] FLAG: --registry-burst="10"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389309    2565 flags.go:64] FLAG: --registry-qps="5"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389312    2565 flags.go:64] FLAG: --reserved-cpus=""
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389314    2565 flags.go:64] FLAG: --reserved-memory=""
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389318    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389321    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389324    2565 flags.go:64] FLAG: --rotate-certificates="false"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389327    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389330    2565 flags.go:64] FLAG: --runonce="false"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389333    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389335    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389338    2565 flags.go:64] FLAG: --seccomp-default="false"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389341    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389359    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389363    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 20:10:07.393284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389366    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389368    2565 flags.go:64] FLAG: --storage-driver-password="root"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389371    2565 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389374    2565 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389377    2565 flags.go:64] FLAG: --storage-driver-user="root"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389380    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389383    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389386    2565 flags.go:64] FLAG: --system-cgroups=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389389    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389394    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389397    2565 flags.go:64] FLAG: --tls-cert-file=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389400    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389409    2565 flags.go:64] FLAG: --tls-min-version=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389412    2565 flags.go:64] FLAG: --tls-private-key-file=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389415    2565 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389417    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389420    2565 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389424    2565 flags.go:64] FLAG: --v="2"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389428    2565 flags.go:64] FLAG: --version="false"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389431    2565 flags.go:64] FLAG: --vmodule=""
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389436    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.389439    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389539    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389544    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 20:10:07.393897 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389547    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389549    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389552    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389555    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389557    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389561    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389566    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389568    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389572    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389574    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389577    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389580    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389582    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389585    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389589    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389591    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389594    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389596    2565 feature_gate.go:328] unrecognized feature gate: Example
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389599    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389601    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 20:10:07.394536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389605    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389607    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389610    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389612    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389615    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389618    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389620    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389623    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389625    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389628    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389630    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389633    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389635    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389639    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389642    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389645    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389648    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389651    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389654    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 20:10:07.395044 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389657    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389659    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389661    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389664    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389666    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389668    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389671    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389673    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389676    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389679    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389681    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389683    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389686    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389689    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389691    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389694    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389696    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389698    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389701    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389703    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 20:10:07.395517 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389706    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389708    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389710    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389713    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389716    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389719    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389722    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389724    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389726    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389728    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389731    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389734    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389736    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389738    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389741    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389743    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389745    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389748    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389750    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389752    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 20:10:07.395988 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389754    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 27 20:10:07.396464 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389757    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 20:10:07.396464 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389760    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 20:10:07.396464 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389762    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 20:10:07.396464 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.389764    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 20:10:07.396464 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.390504    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 20:10:07.396714 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.396695    2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 20:10:07.396745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.396715    2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 20:10:07.396773 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396762    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 20:10:07.396773 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396767    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 20:10:07.396773 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396771    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 20:10:07.396773 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396774    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396777    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396780    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396784    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396788    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396792    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396795    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396798    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396800    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396803    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396805    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396807    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396810    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396812    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396815    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396817    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396820    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396822    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396825    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396827    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 20:10:07.396870 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396830    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396832    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396835    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396838    2565 feature_gate.go:328] unrecognized feature gate: Example
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396840    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396843    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396845    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396848    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396850    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396853    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396855    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396858    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396860    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396863    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396866    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396868    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396871    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396874    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396876    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 20:10:07.397361 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396879    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396882    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396885    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396887    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396890    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396892    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396895    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396897    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396900    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396902    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396904    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396907    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396909    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396912    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396914    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396916    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396919    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396922    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396925    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396927    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 20:10:07.397823 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396930    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396932    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396934    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396936    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396939    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396941    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396944    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396947    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396950    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396952    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396955    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396957    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396960    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396963    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396966    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396969    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396971    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396974    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396976    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396978    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 20:10:07.398284 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396981    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396983    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396986    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.396988    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.396993    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397081    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397085    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397088    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397090    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397094    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397097    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397099    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397101    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397104    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397106    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 20:10:07.398770 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397108    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397111    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397113    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397115    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397118    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397121    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397123    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397126    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397128    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397131    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397135    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397138    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397140    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397143    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397145    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397148    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397150    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397153    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397156    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 20:10:07.399135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397158    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397161    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397163    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397166    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397168    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397170    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397173    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397175    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397178    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397181    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397183    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397185    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397188    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397190    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397192    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397194    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397197    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397199    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397202    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397204    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 20:10:07.399599 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397206    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397208    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397211    2565 feature_gate.go:328] unrecognized feature gate: Example
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397213    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397215    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397218    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397220    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397222    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397225    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397227    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397229    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397232    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397234    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397236    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397238    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397241    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397243    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397245    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397248    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397250    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 20:10:07.400066 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397252    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397255    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397257    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397260    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397262    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397264    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397266    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397269    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397271    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397273    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397276    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397278    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397281    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397283    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397286    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397288    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 20:10:07.400536 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:07.397290    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 20:10:07.400895 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.397295    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 20:10:07.400895 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.398231    2565 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 20:10:07.402428 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.402414    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 20:10:07.403588 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.403578    2565 server.go:1019] "Starting client certificate rotation"
May 27 20:10:07.403697 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.403681    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 20:10:07.403728 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.403721    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 20:10:07.432099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.432081    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 20:10:07.433865 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.433849    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 20:10:07.458296 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.458273    2565 log.go:25] "Validated CRI v1 runtime API"
May 27 20:10:07.466358 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.466326    2565 log.go:25] "Validated CRI v1 image API"
May 27 20:10:07.467696 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.467680    2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 20:10:07.469519 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.469494    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 20:10:07.470188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.470167    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7abfed58-6f85-406c-affb-2244904f6447:/dev/nvme0n1p3 c0ff5426-251f-48f1-9f2d-5f4591af2b64:/dev/nvme0n1p4]
May 27 20:10:07.470257 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.470188    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 20:10:07.474338 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.474230    2565 manager.go:217] Machine: {Timestamp:2026-05-27 20:10:07.473759448 +0000 UTC m=+0.465131294 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199016 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec257e0d4e0218f4b31b98605c1dc8af SystemUUID:ec257e0d-4e02-18f4-b31b-98605c1dc8af BootID:efe44937-5643-470c-8189-715705e95c53 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:b3:f6:18:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:b3:f6:18:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:4e:48:4e:58:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 20:10:07.475137 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.475124    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 20:10:07.475230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.475215    2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 20:10:07.478226 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478201    2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 20:10:07.478364 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478229    2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 20:10:07.478414 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478373    2565 topology_manager.go:138] "Creating topology manager with none policy"
May 27 20:10:07.478414 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478382    2565 container_manager_linux.go:306] "Creating device plugin manager"
May 27 20:10:07.478414 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478389    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 20:10:07.478414 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.478403    2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 20:10:07.480466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.480454    2565 state_mem.go:36] "Initialized new in-memory state store"
May 27 20:10:07.480693 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.480684    2565 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 20:10:07.483666 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.483656    2565 kubelet.go:491] "Attempting to sync node with API server"
May 27 20:10:07.483698 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.483670    2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 20:10:07.483698 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.483683    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 20:10:07.483698 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.483692    2565 kubelet.go:397] "Adding apiserver pod source"
May 27 20:10:07.483822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.483700    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 20:10:07.484900 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.484888    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 20:10:07.484944 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.484906    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 20:10:07.488274 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.488260    2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 20:10:07.490513 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.490477    2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 20:10:07.492791 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492778    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492797    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492806    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492813    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492825    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492834    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492842    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492850    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 20:10:07.492862 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492859    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 20:10:07.493105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492868    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 20:10:07.493105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492887    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 20:10:07.493105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.492896    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 20:10:07.494012 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.494000    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 20:10:07.494068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.494016    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 20:10:07.496152 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.496129    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 20:10:07.496287 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.496271    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 20:10:07.496875 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.496860    2565 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 20:10:07.496952 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.496902    2565 server.go:1295] "Started kubelet"
May 27 20:10:07.499223 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.499147    2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 20:10:07.499294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.499268    2565 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 20:10:07.499826 ip-10-0-129-19 systemd[1]: Started Kubernetes Kubelet.
May 27 20:10:07.499928 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.499837    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 20:10:07.500948 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.500871    2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 20:10:07.502565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.502551    2565 server.go:317] "Adding debug handlers to kubelet server"
May 27 20:10:07.507116 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.507101    2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-19.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 20:10:07.508315 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.507157    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-19.ec2.internal.18b385160d172570  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-19.ec2.internal,UID:ip-10-0-129-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-19.ec2.internal,},FirstTimestamp:2026-05-27 20:10:07.496873328 +0000 UTC m=+0.488245176,LastTimestamp:2026-05-27 20:10:07.496873328 +0000 UTC m=+0.488245176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-19.ec2.internal,}"
May 27 20:10:07.510206 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.510190    2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 20:10:07.510643 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510572    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 20:10:07.510643 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510593    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 20:10:07.510755 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510635    2565 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 20:10:07.510755 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510665    2565 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 20:10:07.510918 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510762    2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 20:10:07.510918 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510815    2565 reconstruct.go:97] "Volume reconstruction finished"
May 27 20:10:07.510918 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.510823    2565 reconciler.go:26] "Reconciler: start to sync state"
May 27 20:10:07.511172 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.511152    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pk67w"
May 27 20:10:07.511538 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.511499    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.511909 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.511889    2565 factory.go:55] Registering systemd factory
May 27 20:10:07.512005 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.511914    2565 factory.go:223] Registration of the systemd container factory successfully
May 27 20:10:07.512143 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512116    2565 factory.go:153] Registering CRI-O factory
May 27 20:10:07.512143 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512144    2565 factory.go:223] Registration of the crio container factory successfully
May 27 20:10:07.512264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512196    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 20:10:07.512264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512213    2565 factory.go:103] Registering Raw factory
May 27 20:10:07.512264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512233    2565 manager.go:1196] Started watching for new ooms in manager
May 27 20:10:07.512620 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.512600    2565 manager.go:319] Starting recovery of all containers
May 27 20:10:07.512707 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.512631    2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 20:10:07.512707 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.512699    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 20:10:07.518660 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.518515    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pk67w"
May 27 20:10:07.521918 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.521904    2565 manager.go:324] Recovery completed
May 27 20:10:07.526488 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.526474    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.528158 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528144    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.528254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528172    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.528254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528193    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.528637 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528624    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 20:10:07.528637 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528636    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 20:10:07.528757 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.528652    2565 state_mem.go:36] "Initialized new in-memory state store"
May 27 20:10:07.532553 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.532537    2565 policy_none.go:49] "None policy: Start"
May 27 20:10:07.532621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.532558    2565 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 20:10:07.532621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.532570    2565 state_mem.go:35] "Initializing new in-memory state store"
May 27 20:10:07.566905 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.566895    2565 manager.go:341] "Starting Device Plugin manager"
May 27 20:10:07.566997 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.566919    2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 20:10:07.566997 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.566928    2565 server.go:85] "Starting device plugin registration server"
May 27 20:10:07.567180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.567166    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 20:10:07.567294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.567182    2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 20:10:07.567294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.567289    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 20:10:07.567411 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.567370    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 20:10:07.567411 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.567378    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 20:10:07.567794 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.567777    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 20:10:07.567898 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.567820    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.623801 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.623773    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 20:10:07.625010 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.624995    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 20:10:07.625084 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.625018    2565 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 20:10:07.625084 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.625034    2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 20:10:07.625084 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.625040    2565 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 20:10:07.625084 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.625071    2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 20:10:07.628308 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.628289    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 20:10:07.668037 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.667996    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.668675 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.668660    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.668760 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.668686    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.668760 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.668696    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.668760 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.668715    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-19.ec2.internal"
May 27 20:10:07.677338 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.677326    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-19.ec2.internal"
May 27 20:10:07.677394 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.677357    2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-19.ec2.internal\": node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.689917 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.689900    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.725683 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.725662    2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"]
May 27 20:10:07.725766 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.725730    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.727189 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.727174    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.727189 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.727198    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.727297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.727208    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.728328 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728317    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.728492 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728478    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.728530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728506    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.728960 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728944    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.728960 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728962    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.729068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728965    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.729068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728971    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.729068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728986    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.729068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.728998    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.730024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.730010    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.730089 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.730041    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 20:10:07.730725 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.730708    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientMemory"
May 27 20:10:07.730804 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.730733    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasNoDiskPressure"
May 27 20:10:07.730804 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.730747    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeHasSufficientPID"
May 27 20:10:07.753865 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.753848    2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-19.ec2.internal\" not found" node="ip-10-0-129-19.ec2.internal"
May 27 20:10:07.758101 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.758087    2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-19.ec2.internal\" not found" node="ip-10-0-129-19.ec2.internal"
May 27 20:10:07.790478 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.790463    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.812421 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.812404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.812468 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.812426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3545e8d242b47d9e14444fc9a6b21b33-config\") pod \"kube-apiserver-proxy-ip-10-0-129-19.ec2.internal\" (UID: \"3545e8d242b47d9e14444fc9a6b21b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.812468 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.812450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.890899 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.890879    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:07.913254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913229    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3545e8d242b47d9e14444fc9a6b21b33-config\") pod \"kube-apiserver-proxy-ip-10-0-129-19.ec2.internal\" (UID: \"3545e8d242b47d9e14444fc9a6b21b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.913307 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913260    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.913307 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913283    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.913383 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913324    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.913417 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913379    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3545e8d242b47d9e14444fc9a6b21b33-config\") pod \"kube-apiserver-proxy-ip-10-0-129-19.ec2.internal\" (UID: \"3545e8d242b47d9e14444fc9a6b21b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.913417 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:07.913405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4da4e4d520dc5df660f7bb742b29ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal\" (UID: \"4d4da4e4d520dc5df660f7bb742b29ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:07.991665 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:07.991625    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.055995 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.055974    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:08.060418 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.060400    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:08.091973 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.091953    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.192413 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.192393    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.292901 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.292859    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.393495 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.393478    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.404647 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.404627    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 20:10:08.404746 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.404732    2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 20:10:08.494464 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.494444    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.511289 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.511272    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 20:10:08.520772 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.520745    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 20:05:07 +0000 UTC" deadline="2027-11-09 18:56:06.577430562 +0000 UTC"
May 27 20:10:08.520831 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.520771    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12742h45m58.056661841s"
May 27 20:10:08.529767 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.529753    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 20:10:08.552845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.552804    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2dxqk"
May 27 20:10:08.560994 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.560974    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2dxqk"
May 27 20:10:08.591085 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:08.591063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4da4e4d520dc5df660f7bb742b29ce.slice/crio-bd587ec77fd2db1b9c1399bf8d6672c443c44be18274b1fcf02b293f20d07c4c WatchSource:0}: Error finding container bd587ec77fd2db1b9c1399bf8d6672c443c44be18274b1fcf02b293f20d07c4c: Status 404 returned error can't find the container with id bd587ec77fd2db1b9c1399bf8d6672c443c44be18274b1fcf02b293f20d07c4c
May 27 20:10:08.591450 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:08.591428    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3545e8d242b47d9e14444fc9a6b21b33.slice/crio-ae65795da18040f862e1be5e47ee8274392706061645ff8bb044aaef7cdff59f WatchSource:0}: Error finding container ae65795da18040f862e1be5e47ee8274392706061645ff8bb044aaef7cdff59f: Status 404 returned error can't find the container with id ae65795da18040f862e1be5e47ee8274392706061645ff8bb044aaef7cdff59f
May 27 20:10:08.594511 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.594495    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.596546 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.596529    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 20:10:08.627690 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.627638    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal" event={"ID":"4d4da4e4d520dc5df660f7bb742b29ce","Type":"ContainerStarted","Data":"bd587ec77fd2db1b9c1399bf8d6672c443c44be18274b1fcf02b293f20d07c4c"}
May 27 20:10:08.628551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.628531    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal" event={"ID":"3545e8d242b47d9e14444fc9a6b21b33","Type":"ContainerStarted","Data":"ae65795da18040f862e1be5e47ee8274392706061645ff8bb044aaef7cdff59f"}
May 27 20:10:08.694690 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:08.694674    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-19.ec2.internal\" not found"
May 27 20:10:08.700550 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.700535    2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 20:10:08.711898 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.711885    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal"
May 27 20:10:08.725858 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.725843    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 20:10:08.728013 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.728000    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal"
May 27 20:10:08.737311 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:08.737299    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 20:10:09.004275 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.004252    2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 20:10:09.084182 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.084164    2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 20:10:09.268286 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.268224    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 20:10:09.484905 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.484874    2565 apiserver.go:52] "Watching apiserver"
May 27 20:10:09.493488 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.493425    2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 20:10:09.493859 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.493833    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv","openshift-image-registry/node-ca-qgcm7","openshift-multus/multus-additional-cni-plugins-r75cn","openshift-network-diagnostics/network-check-target-krvb4","openshift-network-operator/iptables-alerter-pn4qw","openshift-ovn-kubernetes/ovnkube-node-hrv7s","kube-system/konnectivity-agent-cx825","openshift-cluster-node-tuning-operator/tuned-624zp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal","openshift-multus/multus-qnxck","openshift-multus/network-metrics-daemon-89b9c"]
May 27 20:10:09.496487 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.496467    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.498627 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.498602    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.499182 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.499165    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 20:10:09.499276 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.499175    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 20:10:09.499276 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.499238    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6q2gz\""
May 27 20:10:09.499409 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.499248    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 20:10:09.500882 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.500861    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.501340 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.501323    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 20:10:09.501653 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.501639    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-559bl\""
May 27 20:10:09.501886 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.501866    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 20:10:09.501976 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.501967    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 20:10:09.503019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.503000    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:09.503120 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.503087    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:09.503200 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.503174    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 20:10:09.503291 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.503215    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4z98v\""
May 27 20:10:09.503833 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.503531    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 20:10:09.503833 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.503634    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 20:10:09.504339 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.504320    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 20:10:09.504560 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.504544    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 20:10:09.508815 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.508120    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.508815 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.508238    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.510312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.510291    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 20:10:09.510419 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.510316    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 20:10:09.510631 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.510615    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 20:10:09.510748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.510732    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.511188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.511169    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 20:10:09.511521 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.511503    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x77qr\""
May 27 20:10:09.511596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.511531    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8bkrs\""
May 27 20:10:09.511777 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.511764    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 20:10:09.513323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.513000    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rqnn5\""
May 27 20:10:09.513323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.513029    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qnxck"
May 27 20:10:09.513323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.513216    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 20:10:09.514254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.514237    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 20:10:09.515711 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.515225    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wrcvn\""
May 27 20:10:09.515711 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.515492    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 20:10:09.517855 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.517787    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.517941 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.517856    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:09.518126 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.518102    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.519881 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.519881 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-sys\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cnibin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-k8s-cni-cncf-io\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c37a2e35-1576-4b24-bb4f-3690318cefd9-serviceca\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.519977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-kubelet\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-var-lib-kubelet\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-systemd\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-os-release\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzxv\" (UniqueName: \"kubernetes.io/projected/45b767a9-a1bd-485d-abfb-d9e8217553d4-kube-api-access-cbzxv\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.520216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6688a634-a547-4c54-879b-1b3bdf967ab9-agent-certs\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-netns\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-daemon-config\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg5nm\" (UniqueName: \"kubernetes.io/projected/c37a2e35-1576-4b24-bb4f-3690318cefd9-kube-api-access-zg5nm\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cnibin\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-os-release\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45b767a9-a1bd-485d-abfb-d9e8217553d4-host-slash\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-run\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwl2r\" (UniqueName: \"kubernetes.io/projected/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-kube-api-access-hwl2r\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6688a634-a547-4c54-879b-1b3bdf967ab9-konnectivity-ca\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-kubernetes\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-conf\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-lib-modules\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cni-binary-copy\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-tmp\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4t5h\" (UniqueName: \"kubernetes.io/projected/5d0f68c9-7d35-470e-b6a4-94be262de911-kube-api-access-m4t5h\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-system-cni-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwdgz\" (UniqueName: \"kubernetes.io/projected/024f0df1-5615-43fb-bf61-1e22de9311d5-kube-api-access-vwdgz\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.520962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.520770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-bin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.522333 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-hostroot\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.522447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.522447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522410    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 20:10:09.522447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-host\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.522589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-tuned\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.522589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-socket-dir-parent\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.522589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-etc-kubernetes\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.522933 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522916    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 20:10:09.523016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2ws4\" (UniqueName: \"kubernetes.io/projected/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-kube-api-access-q2ws4\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.523068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.522978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:09.523115 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-conf-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.523115 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-system-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.523210 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-multus\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.523210 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-device-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.523210 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523194    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 20:10:09.523494 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-multus-certs\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.524013 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.523987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.524094 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524044    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 20:10:09.524146 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.524198 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45b767a9-a1bd-485d-abfb-d9e8217553d4-iptables-alerter-script\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.524248 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-modprobe-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.524248 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c37a2e35-1576-4b24-bb4f-3690318cefd9-host\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.524339 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysconfig\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.524418 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524388    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 20:10:09.524464 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524440    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 20:10:09.526151 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.524722    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-phtdq\""
May 27 20:10:09.561521 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.561487    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 20:05:08 +0000 UTC" deadline="2027-11-26 02:15:11.619173846 +0000 UTC"
May 27 20:10:09.561521 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.561521    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13134h5m2.057656254s"
May 27 20:10:09.611642 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.611620    2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 20:10:09.625146 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625119    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-systemd\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.625263 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625159    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-os-release\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.625263 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625187    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.625263 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625215    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzxv\" (UniqueName: \"kubernetes.io/projected/45b767a9-a1bd-485d-abfb-d9e8217553d4-kube-api-access-cbzxv\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.625551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625532    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6688a634-a547-4c54-879b-1b3bdf967ab9-agent-certs\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.625614 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625563    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-netns\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.625614 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625255    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-os-release\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.625614 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-systemd\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.625750 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-netns\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.625750 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625587    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-daemon-config\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.625750 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625712    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg5nm\" (UniqueName: \"kubernetes.io/projected/c37a2e35-1576-4b24-bb4f-3690318cefd9-kube-api-access-zg5nm\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-netns\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-script-lib\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625794    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625806    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cnibin\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625833    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-os-release\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.625879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625858    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45b767a9-a1bd-485d-abfb-d9e8217553d4-host-slash\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45b767a9-a1bd-485d-abfb-d9e8217553d4-host-slash\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625924    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-run\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk44b\" (UniqueName: \"kubernetes.io/projected/e2ca65ad-7d95-411a-b130-837842fb0836-kube-api-access-mk44b\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625962    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.625995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-log-socket\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626034    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626057    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl2r\" (UniqueName: \"kubernetes.io/projected/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-kube-api-access-hwl2r\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626082    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626105    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6688a634-a547-4c54-879b-1b3bdf967ab9-konnectivity-ca\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626113    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-run\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626130    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-kubernetes\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626152    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626165    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-conf\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626196    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-lib-modules\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626219    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-os-release\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626213    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cni-binary-copy\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626264    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-tmp\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626293    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4t5h\" (UniqueName: \"kubernetes.io/projected/5d0f68c9-7d35-470e-b6a4-94be262de911-kube-api-access-m4t5h\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626321    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-kubernetes\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-ovn\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysctl-conf\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626262    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-daemon-config\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626626    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cni-binary-copy\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626163    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cnibin\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.626686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626736    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6688a634-a547-4c54-879b-1b3bdf967ab9-konnectivity-ca\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626797    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-lib-modules\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-node-log\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.626863    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-system-cni-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627047    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-system-cni-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627073    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwdgz\" (UniqueName: \"kubernetes.io/projected/024f0df1-5615-43fb-bf61-1e22de9311d5-kube-api-access-vwdgz\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-env-overrides\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627197    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-bin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627222    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-hostroot\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627249    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627272    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-host\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.627304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627295    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-tuned\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627313    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-bin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovn-node-metrics-cert\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627366    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-socket-dir-parent\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627375    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-sys-fs\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627392    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-etc-kubernetes\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627419    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2ws4\" (UniqueName: \"kubernetes.io/projected/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-kube-api-access-q2ws4\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-hostroot\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627417    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-host\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627476    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627495    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-etc-kubernetes\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb75p\" (UniqueName: \"kubernetes.io/projected/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-kube-api-access-qb75p\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627531    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-conf-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-kubelet\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627610    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-system-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628016 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627614    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-socket-dir-parent\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627634    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-multus\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627656    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-multus-conf-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627659    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-device-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-systemd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-bin\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627736    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-multus-certs\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627756    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-system-cni-dir\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627762    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627790    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-cni-multus\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627815    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45b767a9-a1bd-485d-abfb-d9e8217553d4-iptables-alerter-script\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627852    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-modprobe-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627874    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-device-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-systemd-units\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-config\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627932    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c37a2e35-1576-4b24-bb4f-3690318cefd9-host\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.628745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627954    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysconfig\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627967    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-modprobe-d\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.627977    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628014    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628029    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-sys\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-slash\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628051    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-registration-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-var-lib-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628130    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cnibin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628170    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-k8s-cni-cncf-io\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-socket-dir\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628207    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c37a2e35-1576-4b24-bb4f-3690318cefd9-serviceca\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628227    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-sys\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628246    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628258    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-multus-certs\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.629447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-netd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628309    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-kubelet\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628341    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-cnibin\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628337    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-var-lib-kubelet\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628362    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45b767a9-a1bd-485d-abfb-d9e8217553d4-iptables-alerter-script\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-etc-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628401    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-var-lib-kubelet\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c37a2e35-1576-4b24-bb4f-3690318cefd9-host\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-var-lib-kubelet\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628458    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/024f0df1-5615-43fb-bf61-1e22de9311d5-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628312    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-sysconfig\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.628509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-host-run-k8s-cni-cncf-io\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.629406    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c37a2e35-1576-4b24-bb4f-3690318cefd9-serviceca\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.629433    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-tmp\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.629683    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d0f68c9-7d35-470e-b6a4-94be262de911-etc-tuned\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.629762    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.630249 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.629902    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6688a634-a547-4c54-879b-1b3bdf967ab9-agent-certs\") pod \"konnectivity-agent-cx825\" (UID: \"6688a634-a547-4c54-879b-1b3bdf967ab9\") " pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.636621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.636254    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzxv\" (UniqueName: \"kubernetes.io/projected/45b767a9-a1bd-485d-abfb-d9e8217553d4-kube-api-access-cbzxv\") pod \"iptables-alerter-pn4qw\" (UID: \"45b767a9-a1bd-485d-abfb-d9e8217553d4\") " pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.636716 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.636658    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:09.636716 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.636686    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:09.636716 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.636700    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:09.636864 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.636765    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:10.136746414 +0000 UTC m=+3.128118265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:09.637337 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.636974    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwdgz\" (UniqueName: \"kubernetes.io/projected/024f0df1-5615-43fb-bf61-1e22de9311d5-kube-api-access-vwdgz\") pod \"aws-ebs-csi-driver-node-9njgv\" (UID: \"024f0df1-5615-43fb-bf61-1e22de9311d5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.637337 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.637301    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwl2r\" (UniqueName: \"kubernetes.io/projected/7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe-kube-api-access-hwl2r\") pod \"multus-qnxck\" (UID: \"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe\") " pod="openshift-multus/multus-qnxck"
May 27 20:10:09.637498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.637473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4t5h\" (UniqueName: \"kubernetes.io/projected/5d0f68c9-7d35-470e-b6a4-94be262de911-kube-api-access-m4t5h\") pod \"tuned-624zp\" (UID: \"5d0f68c9-7d35-470e-b6a4-94be262de911\") " pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.638391 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.638374    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg5nm\" (UniqueName: \"kubernetes.io/projected/c37a2e35-1576-4b24-bb4f-3690318cefd9-kube-api-access-zg5nm\") pod \"node-ca-qgcm7\" (UID: \"c37a2e35-1576-4b24-bb4f-3690318cefd9\") " pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.639153 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.639130    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2ws4\" (UniqueName: \"kubernetes.io/projected/a0e7422f-c7ed-4abd-9ad7-055fcc824cfb-kube-api-access-q2ws4\") pod \"multus-additional-cni-plugins-r75cn\" (UID: \"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb\") " pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.729416 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729388    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-netns\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729416 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729419    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-script-lib\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729607 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729438    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk44b\" (UniqueName: \"kubernetes.io/projected/e2ca65ad-7d95-411a-b130-837842fb0836-kube-api-access-mk44b\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.729607 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729511    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-netns\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729607 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729555    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-log-socket\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729607 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729600    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-ovn\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729625    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-node-log\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729656    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729657    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-ovn\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729701    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729709    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-node-log\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729727    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-env-overrides\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-log-socket\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.729774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729755    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovn-node-metrics-cert\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729794    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb75p\" (UniqueName: \"kubernetes.io/projected/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-kube-api-access-qb75p\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729809    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-kubelet\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729824    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729841    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-systemd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729870    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-bin\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729888    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-systemd-units\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729890    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-kubelet\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729927    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729972    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-run-systemd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729991    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-bin\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-systemd-units\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730016    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-script-lib\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.729901    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-config\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730053    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-slash\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730067    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-var-lib-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730080    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730170 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-slash\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-var-lib-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-env-overrides\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730159    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-netd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730188    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-host-cni-netd\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730213    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-etc-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-etc-openvswitch\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.730300    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovnkube-config\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.730316    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:09.730827 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:09.730397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:10.230378121 +0000 UTC m=+3.221749975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:09.732266 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.732244    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-ovn-node-metrics-cert\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.738961 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.738939    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb75p\" (UniqueName: \"kubernetes.io/projected/e03dc10b-bce7-49fe-a5a3-b675cea56bdb-kube-api-access-qb75p\") pod \"ovnkube-node-hrv7s\" (UID: \"e03dc10b-bce7-49fe-a5a3-b675cea56bdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:09.739236 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.739213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk44b\" (UniqueName: \"kubernetes.io/projected/e2ca65ad-7d95-411a-b130-837842fb0836-kube-api-access-mk44b\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:09.809161 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.809103    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv"
May 27 20:10:09.816691 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.816669    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgcm7"
May 27 20:10:09.831443 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.831419    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r75cn"
May 27 20:10:09.835023 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.834995    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pn4qw"
May 27 20:10:09.842513 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.842484    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:09.851068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.851050    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-624zp"
May 27 20:10:09.858636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.858619    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qnxck"
May 27 20:10:09.863205 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:09.863188    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:10.233807 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.233728    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:10.233807 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.233789    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233902    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233915    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233939    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233953    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233963    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:11.233943354 +0000 UTC m=+4.225315208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:10.234016 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:10.233997    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:11.23398671 +0000 UTC m=+4.225358544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:10.330503 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.330469    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03dc10b_bce7_49fe_a5a3_b675cea56bdb.slice/crio-9cc179ab2819f4e680b6f4cedda235fbe5ddd6c3ffafc0ab06357bf4ff150fc6 WatchSource:0}: Error finding container 9cc179ab2819f4e680b6f4cedda235fbe5ddd6c3ffafc0ab06357bf4ff150fc6: Status 404 returned error can't find the container with id 9cc179ab2819f4e680b6f4cedda235fbe5ddd6c3ffafc0ab06357bf4ff150fc6
May 27 20:10:10.331227 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.331174    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc2a48e_3ae5_4529_abdb_17b6a6f3ffbe.slice/crio-70fcdd1727308b87bdb6ea824bd055230f655053a300d7cf69f8b8c108e6af6b WatchSource:0}: Error finding container 70fcdd1727308b87bdb6ea824bd055230f655053a300d7cf69f8b8c108e6af6b: Status 404 returned error can't find the container with id 70fcdd1727308b87bdb6ea824bd055230f655053a300d7cf69f8b8c108e6af6b
May 27 20:10:10.332333 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.332302    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0f68c9_7d35_470e_b6a4_94be262de911.slice/crio-4ef980dbad0d04ad62a6734cf77aa2e0a708174a05434998217a818a1523196e WatchSource:0}: Error finding container 4ef980dbad0d04ad62a6734cf77aa2e0a708174a05434998217a818a1523196e: Status 404 returned error can't find the container with id 4ef980dbad0d04ad62a6734cf77aa2e0a708174a05434998217a818a1523196e
May 27 20:10:10.333982 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.333686    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024f0df1_5615_43fb_bf61_1e22de9311d5.slice/crio-a0c75f0e0d13a69818aa6e9600fba4d9b23968a0cdf3b46f7e7a869ff5899af9 WatchSource:0}: Error finding container a0c75f0e0d13a69818aa6e9600fba4d9b23968a0cdf3b46f7e7a869ff5899af9: Status 404 returned error can't find the container with id a0c75f0e0d13a69818aa6e9600fba4d9b23968a0cdf3b46f7e7a869ff5899af9
May 27 20:10:10.335399 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.335305    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6688a634_a547_4c54_879b_1b3bdf967ab9.slice/crio-483fab95dc3042517309fb392ed9ac0e6063c224ee4ed25349beba9ed5478701 WatchSource:0}: Error finding container 483fab95dc3042517309fb392ed9ac0e6063c224ee4ed25349beba9ed5478701: Status 404 returned error can't find the container with id 483fab95dc3042517309fb392ed9ac0e6063c224ee4ed25349beba9ed5478701
May 27 20:10:10.336133 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.336045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37a2e35_1576_4b24_bb4f_3690318cefd9.slice/crio-479f6710c898656a7d9e1dca8f2dd5d6c51a0c769ec5cd6ece57159eb8ef36e7 WatchSource:0}: Error finding container 479f6710c898656a7d9e1dca8f2dd5d6c51a0c769ec5cd6ece57159eb8ef36e7: Status 404 returned error can't find the container with id 479f6710c898656a7d9e1dca8f2dd5d6c51a0c769ec5cd6ece57159eb8ef36e7
May 27 20:10:10.336921 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.336869    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b767a9_a1bd_485d_abfb_d9e8217553d4.slice/crio-47e893dd7d110f60cdcfc1b59a7eed99151189f1fe1d28f78215c639463ddad2 WatchSource:0}: Error finding container 47e893dd7d110f60cdcfc1b59a7eed99151189f1fe1d28f78215c639463ddad2: Status 404 returned error can't find the container with id 47e893dd7d110f60cdcfc1b59a7eed99151189f1fe1d28f78215c639463ddad2
May 27 20:10:10.338314 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:10.338284    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e7422f_c7ed_4abd_9ad7_055fcc824cfb.slice/crio-6dd308a4a137320a18b959bb521a9d52d7b44b553a8e58a5f273d24bad662a6f WatchSource:0}: Error finding container 6dd308a4a137320a18b959bb521a9d52d7b44b553a8e58a5f273d24bad662a6f: Status 404 returned error can't find the container with id 6dd308a4a137320a18b959bb521a9d52d7b44b553a8e58a5f273d24bad662a6f
May 27 20:10:10.562055 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.561831    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 20:05:08 +0000 UTC" deadline="2028-01-07 21:32:52.195485411 +0000 UTC"
May 27 20:10:10.562055 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.561988    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14161h22m41.633499731s"
May 27 20:10:10.632155 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.632119    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal" event={"ID":"3545e8d242b47d9e14444fc9a6b21b33","Type":"ContainerStarted","Data":"4136f0ad7c60430d9e3dc9fbf592fc6e1253e4e2173d6a85c9d7c01b9705a4c8"}
May 27 20:10:10.633281 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.633260    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerStarted","Data":"6dd308a4a137320a18b959bb521a9d52d7b44b553a8e58a5f273d24bad662a6f"}
May 27 20:10:10.634152 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.634132    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pn4qw" event={"ID":"45b767a9-a1bd-485d-abfb-d9e8217553d4","Type":"ContainerStarted","Data":"47e893dd7d110f60cdcfc1b59a7eed99151189f1fe1d28f78215c639463ddad2"}
May 27 20:10:10.634916 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.634898    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx825" event={"ID":"6688a634-a547-4c54-879b-1b3bdf967ab9","Type":"ContainerStarted","Data":"483fab95dc3042517309fb392ed9ac0e6063c224ee4ed25349beba9ed5478701"}
May 27 20:10:10.635689 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.635661    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qnxck" event={"ID":"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe","Type":"ContainerStarted","Data":"70fcdd1727308b87bdb6ea824bd055230f655053a300d7cf69f8b8c108e6af6b"}
May 27 20:10:10.636564 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.636545    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"9cc179ab2819f4e680b6f4cedda235fbe5ddd6c3ffafc0ab06357bf4ff150fc6"}
May 27 20:10:10.637636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.637613    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgcm7" event={"ID":"c37a2e35-1576-4b24-bb4f-3690318cefd9","Type":"ContainerStarted","Data":"479f6710c898656a7d9e1dca8f2dd5d6c51a0c769ec5cd6ece57159eb8ef36e7"}
May 27 20:10:10.638596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.638575    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv" event={"ID":"024f0df1-5615-43fb-bf61-1e22de9311d5","Type":"ContainerStarted","Data":"a0c75f0e0d13a69818aa6e9600fba4d9b23968a0cdf3b46f7e7a869ff5899af9"}
May 27 20:10:10.639484 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.639465    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-624zp" event={"ID":"5d0f68c9-7d35-470e-b6a4-94be262de911","Type":"ContainerStarted","Data":"4ef980dbad0d04ad62a6734cf77aa2e0a708174a05434998217a818a1523196e"}
May 27 20:10:10.647335 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:10.647301    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-19.ec2.internal" podStartSLOduration=2.647290495 podStartE2EDuration="2.647290495s" podCreationTimestamp="2026-05-27 20:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:10:10.647004783 +0000 UTC m=+3.638376638" watchObservedRunningTime="2026-05-27 20:10:10.647290495 +0000 UTC m=+3.638662351"
May 27 20:10:11.238792 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.238756    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:11.238971 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.238822    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:11.238971 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.238960    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:11.239073 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.239021    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:13.239003012 +0000 UTC m=+6.230374869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:11.239452 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.239432    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:11.239563 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.239459    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:11.239563 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.239471    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:11.239563 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.239517    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:13.239502562 +0000 UTC m=+6.230874398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:11.627759 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.627691    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:11.628163 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.627807    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:11.628250 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.628229    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:11.628385 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:11.628365    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:11.651869 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.651228    2565 generic.go:358] "Generic (PLEG): container finished" podID="4d4da4e4d520dc5df660f7bb742b29ce" containerID="b90c93f49afa1701ba064d61094105efa9463246c58f550ce59aa4152c6fe118" exitCode=0
May 27 20:10:11.651869 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:11.651708    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal" event={"ID":"4d4da4e4d520dc5df660f7bb742b29ce","Type":"ContainerDied","Data":"b90c93f49afa1701ba064d61094105efa9463246c58f550ce59aa4152c6fe118"}
May 27 20:10:12.661841 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:12.661196    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal" event={"ID":"4d4da4e4d520dc5df660f7bb742b29ce","Type":"ContainerStarted","Data":"94ec360cbe14a2776517a4ecd5873b74a8ca71f8735ae8307749766278d808ee"}
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:13.253433    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:13.253501    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.253638    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.253656    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.253667    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.253721    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:17.253702633 +0000 UTC m=+10.245074471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.253962    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:13.254374 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.254028    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:17.25399711 +0000 UTC m=+10.245368945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:13.625676 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:13.625596    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:13.625835 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.625737    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:13.628140 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:13.628116    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:13.628241 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:13.628201    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:14.226423 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.225404    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-19.ec2.internal" podStartSLOduration=6.225382633 podStartE2EDuration="6.225382633s" podCreationTimestamp="2026-05-27 20:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:10:12.675792243 +0000 UTC m=+5.667164100" watchObservedRunningTime="2026-05-27 20:10:14.225382633 +0000 UTC m=+7.216754491"
May 27 20:10:14.226423 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.225655    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-w5zqm"]
May 27 20:10:14.230680 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.230660    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.233717 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.233693    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ggcvg\""
May 27 20:10:14.233907 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.233893    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 20:10:14.234103 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.234088    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 20:10:14.262566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.262539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-tmp-dir\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.262682 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.262611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66lnw\" (UniqueName: \"kubernetes.io/projected/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-kube-api-access-66lnw\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.262682 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.262639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-hosts-file\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.363398 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.363332    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66lnw\" (UniqueName: \"kubernetes.io/projected/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-kube-api-access-66lnw\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.363398 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.363391    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-hosts-file\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.363550 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.363440    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-tmp-dir\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.363773 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.363755    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-tmp-dir\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.364084 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.364065    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-hosts-file\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.378623 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.378576    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66lnw\" (UniqueName: \"kubernetes.io/projected/b4a3cc56-1f86-42a9-bd25-ca35760c5f27-kube-api-access-66lnw\") pod \"node-resolver-w5zqm\" (UID: \"b4a3cc56-1f86-42a9-bd25-ca35760c5f27\") " pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:14.544047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:14.543975    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5zqm"
May 27 20:10:15.625908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:15.625482    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:15.625908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:15.625482    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:15.625908 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:15.625624    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:15.625908 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:15.625692    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:17.284478 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:17.284430    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:17.284906 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:17.284500    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:17.284906 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.284643    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:17.284906 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.284707    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:25.284687979 +0000 UTC m=+18.276059822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:17.285066 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.285032    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:17.285066 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.285046    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:17.285066 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.285054    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:17.285175 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.285083    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:25.285073901 +0000 UTC m=+18.276445735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:17.626017 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:17.625940    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:17.626165 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.626066    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:17.626469 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:17.626451    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:17.626538 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:17.626515    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:19.626192 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:19.626162    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:19.626604 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:19.626282    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:19.626660 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:19.626644    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:19.626744 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:19.626726    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:21.625913 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:21.625878    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:21.626401 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:21.625892    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:21.626401 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:21.625982    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:21.626401 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:21.626078    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:23.628073 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:23.628053    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:23.628387 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:23.628052    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:23.628387 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:23.628137    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:23.628387 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:23.628219    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:25.349506 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:25.349462    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:25.349529    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349629    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349643    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349660    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349671    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349696    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:41.349675027 +0000 UTC m=+34.341046881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:25.349959 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.349715    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:10:41.34970649 +0000 UTC m=+34.341078326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:25.628595 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:25.628517    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:25.628733 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.628619    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:25.629003 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:25.628986    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:25.629082 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:25.629066    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:27.626780 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:27.626739    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:27.627192 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:27.626846    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:27.627192 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:27.626936    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:27.627192 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:27.627043    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:28.278680 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:10:28.278656    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a3cc56_1f86_42a9_bd25_ca35760c5f27.slice/crio-6b96dea2bb4c56c2cc95ce0cb8048e8a3422a8813fa029e1d883823b2c170ef1 WatchSource:0}: Error finding container 6b96dea2bb4c56c2cc95ce0cb8048e8a3422a8813fa029e1d883823b2c170ef1: Status 404 returned error can't find the container with id 6b96dea2bb4c56c2cc95ce0cb8048e8a3422a8813fa029e1d883823b2c170ef1
May 27 20:10:28.686327 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.686153    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv" event={"ID":"024f0df1-5615-43fb-bf61-1e22de9311d5","Type":"ContainerStarted","Data":"7aae052a017d0003dd5792781ae4f0cef69b296d6b7d6f74e4ad5b61e7cd08fe"}
May 27 20:10:28.687563 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.687538    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-624zp" event={"ID":"5d0f68c9-7d35-470e-b6a4-94be262de911","Type":"ContainerStarted","Data":"0ca38169e340fb84f7e815ad5e6a79b8d51623c90410fad18783f267774fc13e"}
May 27 20:10:28.688987 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.688963    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerStarted","Data":"77c789bd68129ca60a7377f5ab9775e3ce3ae631fb5bbac54d6167ee7fa9c5b4"}
May 27 20:10:28.690392 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.690366    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx825" event={"ID":"6688a634-a547-4c54-879b-1b3bdf967ab9","Type":"ContainerStarted","Data":"5e100a9e5144815f5db831faca613569f5d2ec21a75b7409350e22387ea5739d"}
May 27 20:10:28.691870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.691742    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qnxck" event={"ID":"7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe","Type":"ContainerStarted","Data":"2f049c6fbadf70904ecac88eaae5120c72096e6fecf180cbb93efe788f0ac12a"}
May 27 20:10:28.693046 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.693026    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5zqm" event={"ID":"b4a3cc56-1f86-42a9-bd25-ca35760c5f27","Type":"ContainerStarted","Data":"1aaeccec681a45444ec5abe02d038ebb8074fb096bb329731f3e72e7dd48d477"}
May 27 20:10:28.693126 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.693053    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5zqm" event={"ID":"b4a3cc56-1f86-42a9-bd25-ca35760c5f27","Type":"ContainerStarted","Data":"6b96dea2bb4c56c2cc95ce0cb8048e8a3422a8813fa029e1d883823b2c170ef1"}
May 27 20:10:28.694253 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.694234    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgcm7" event={"ID":"c37a2e35-1576-4b24-bb4f-3690318cefd9","Type":"ContainerStarted","Data":"cd1b30d35a200b781aa057ee3e6e2670278e3a5d311e4a86093a4aa861dd9f33"}
May 27 20:10:28.702846 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.702797    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-624zp" podStartSLOduration=3.684337296 podStartE2EDuration="21.702782837s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.334895539 +0000 UTC m=+3.326267391" lastFinishedPulling="2026-05-27 20:10:28.353341087 +0000 UTC m=+21.344712932" observedRunningTime="2026-05-27 20:10:28.702110383 +0000 UTC m=+21.693482240" watchObservedRunningTime="2026-05-27 20:10:28.702782837 +0000 UTC m=+21.694154695"
May 27 20:10:28.717122 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.717088    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qnxck" podStartSLOduration=3.69705894 podStartE2EDuration="21.717076252s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.332981276 +0000 UTC m=+3.324353110" lastFinishedPulling="2026-05-27 20:10:28.352998575 +0000 UTC m=+21.344370422" observedRunningTime="2026-05-27 20:10:28.716790039 +0000 UTC m=+21.708161896" watchObservedRunningTime="2026-05-27 20:10:28.717076252 +0000 UTC m=+21.708448108"
May 27 20:10:28.737998 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.737960    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qgcm7" podStartSLOduration=8.49606685 podStartE2EDuration="21.737949821s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.337858654 +0000 UTC m=+3.329230503" lastFinishedPulling="2026-05-27 20:10:23.579741639 +0000 UTC m=+16.571113474" observedRunningTime="2026-05-27 20:10:28.736722588 +0000 UTC m=+21.728094444" watchObservedRunningTime="2026-05-27 20:10:28.737949821 +0000 UTC m=+21.729321676"
May 27 20:10:28.753668 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.753636    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cx825" podStartSLOduration=8.511008538 podStartE2EDuration="21.753623376s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.337174975 +0000 UTC m=+3.328546815" lastFinishedPulling="2026-05-27 20:10:23.579789818 +0000 UTC m=+16.571161653" observedRunningTime="2026-05-27 20:10:28.753506216 +0000 UTC m=+21.744878074" watchObservedRunningTime="2026-05-27 20:10:28.753623376 +0000 UTC m=+21.744995231"
May 27 20:10:28.800210 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:28.800094    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-w5zqm" podStartSLOduration=14.800081198 podStartE2EDuration="14.800081198s" podCreationTimestamp="2026-05-27 20:10:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:10:28.767850459 +0000 UTC m=+21.759222319" watchObservedRunningTime="2026-05-27 20:10:28.800081198 +0000 UTC m=+21.791453060"
May 27 20:10:29.625984 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.625949    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:29.626246 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.625997    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:29.626246 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:29.626077    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:29.626246 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:29.626212    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:29.697183 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.697158    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="77c789bd68129ca60a7377f5ab9775e3ce3ae631fb5bbac54d6167ee7fa9c5b4" exitCode=0
May 27 20:10:29.697598 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.697233    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"77c789bd68129ca60a7377f5ab9775e3ce3ae631fb5bbac54d6167ee7fa9c5b4"}
May 27 20:10:29.699720 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.699009    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pn4qw" event={"ID":"45b767a9-a1bd-485d-abfb-d9e8217553d4","Type":"ContainerStarted","Data":"5bd49b05b5dadf84b3a5f60a83e8d9cbffcf0d70431906186c2596b041429609"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703308    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"60f947eef0203d3ae9f02b08dbb31aeefb5394023345b29f235efdccd73bee5a"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703330    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"fec9436f954af1c1374ac2d4ba32bc10c1e3ae0684b4f8baafb45cae2c9ff15d"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703341    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"79488e4481ff9e0b6eecbbe727084acd1913fcd37941018a4fe650a08d38a292"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703375    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"8f49913393360edbaba8e1c77dd4b71b69069b7429d7461fe328e38278677051"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703383    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"b458387ea76dc2d6910cdadd08d10455db3f0896f736a45f8267377e3c179f80"}
May 27 20:10:29.704312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.703391    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"d82193360eab365c821032064666c88a23ef73043048977ea93961a682147924"}
May 27 20:10:29.729923 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.729887    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pn4qw" podStartSLOduration=4.746232036 podStartE2EDuration="22.729877567s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.338948208 +0000 UTC m=+3.330320045" lastFinishedPulling="2026-05-27 20:10:28.322593727 +0000 UTC m=+21.313965576" observedRunningTime="2026-05-27 20:10:29.729742739 +0000 UTC m=+22.721114595" watchObservedRunningTime="2026-05-27 20:10:29.729877567 +0000 UTC m=+22.721249422"
May 27 20:10:29.745189 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:29.745172    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 20:10:30.586514 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:30.586408    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T20:10:29.745185274Z","UUID":"4e874c1c-4876-438e-99a9-308223b25a18","Handler":null,"Name":"","Endpoint":""}
May 27 20:10:30.589472 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:30.589379    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 20:10:30.589472 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:30.589415    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 20:10:30.706709 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:30.706684    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv" event={"ID":"024f0df1-5615-43fb-bf61-1e22de9311d5","Type":"ContainerStarted","Data":"88660362c2d9d9b36c2598370968b7cac30f3d81d3e85ab7a177c770ea2b286e"}
May 27 20:10:31.625821 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:31.625589    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:31.625955 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:31.625668    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:31.625955 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:31.625861    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:31.626039 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:31.625982    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:31.710383 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:31.710336    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"9f4bc0a90a97fe89b4c49bd0eceba57cdf66facce90ad01e2a12c93f751410a5"}
May 27 20:10:31.711863 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:31.711845    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv" event={"ID":"024f0df1-5615-43fb-bf61-1e22de9311d5","Type":"ContainerStarted","Data":"044eff3bbfeec2722dc22ae134eef51899f90385bc57214787c4130728ab613d"}
May 27 20:10:31.729420 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:31.729385    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njgv" podStartSLOduration=4.43065382 podStartE2EDuration="24.729375296s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.335598915 +0000 UTC m=+3.326970749" lastFinishedPulling="2026-05-27 20:10:30.634320387 +0000 UTC m=+23.625692225" observedRunningTime="2026-05-27 20:10:31.72918143 +0000 UTC m=+24.720553284" watchObservedRunningTime="2026-05-27 20:10:31.729375296 +0000 UTC m=+24.720747152"
May 27 20:10:32.073097 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:32.073034    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:32.382475 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:32.382412    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:32.382914 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:32.382899    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:32.714427 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:32.714369    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cx825"
May 27 20:10:33.625571 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:33.625498    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:33.625571 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:33.625518    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:33.625770 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:33.625616    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:33.625770 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:33.625710    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:34.719287 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:34.718971    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" event={"ID":"e03dc10b-bce7-49fe-a5a3-b675cea56bdb","Type":"ContainerStarted","Data":"1c7cb87c66d7b18e77e05845a544a7e8ecccddc7b72738bee18a4bb2c6f5e0c0"}
May 27 20:10:34.752885 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:34.752845    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s" podStartSLOduration=8.474245258 podStartE2EDuration="26.752832788s" podCreationTimestamp="2026-05-27 20:10:08 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.332231146 +0000 UTC m=+3.323602980" lastFinishedPulling="2026-05-27 20:10:28.610818672 +0000 UTC m=+21.602190510" observedRunningTime="2026-05-27 20:10:34.75148758 +0000 UTC m=+27.742859438" watchObservedRunningTime="2026-05-27 20:10:34.752832788 +0000 UTC m=+27.744204643"
May 27 20:10:35.630179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.630151    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:35.630366 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.630191    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:35.630366 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:35.630265    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:35.630448 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:35.630415    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:35.723987 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.723628    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="0ab7b741c4f1e16317040a4f2392e7b3ce3b868daeec8d736c4fd844469cc81e" exitCode=0
May 27 20:10:35.723987 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.723792    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"0ab7b741c4f1e16317040a4f2392e7b3ce3b868daeec8d736c4fd844469cc81e"}
May 27 20:10:35.725386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.725297    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:35.725386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.725325    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:35.725386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.725337    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:35.741234 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.741215    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:35.741322 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:35.741281    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:10:36.378506 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:36.378479    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krvb4"]
May 27 20:10:36.378775 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:36.378575    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:36.378775 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:36.378683    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:36.381099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:36.380929    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89b9c"]
May 27 20:10:36.381099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:36.381002    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:36.381099 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:36.381070    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:37.626407 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:37.626383    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:37.626700 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:37.626460    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:37.728685 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:37.728652    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="354c75b012516bf8457f87e52517a3c060201f9f865001b0d2f28cd6ccd5adff" exitCode=0
May 27 20:10:37.728825 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:37.728785    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"354c75b012516bf8457f87e52517a3c060201f9f865001b0d2f28cd6ccd5adff"}
May 27 20:10:38.625758 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:38.625611    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:38.625901 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:38.625857    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:39.625927 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:39.625903    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:39.626278 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:39.626009    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:39.732823 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:39.732802    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="23b4003c62f5cccf81bac3a8365fa52ae3af04aeb69692ccb5b8e70e54db49b9" exitCode=0
May 27 20:10:39.732936 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:39.732852    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"23b4003c62f5cccf81bac3a8365fa52ae3af04aeb69692ccb5b8e70e54db49b9"}
May 27 20:10:40.626135 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:40.626108    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:40.626673 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:40.626271    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:10:41.376094 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:41.376064    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:41.376108    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376200    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376204    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376222    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376230    2565 projected.go:194] Error preparing data for projected volume kube-api-access-2vjgr for pod openshift-network-diagnostics/network-check-target-krvb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:41.376262 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376255    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:13.376240425 +0000 UTC m=+66.367612263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 20:10:41.376474 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.376268    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr podName:b862641e-a55e-42c3-a151-944fd0c1470a nodeName:}" failed. No retries permitted until 2026-05-27 20:11:13.376262162 +0000 UTC m=+66.367633996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vjgr" (UniqueName: "kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr") pod "network-check-target-krvb4" (UID: "b862641e-a55e-42c3-a151-944fd0c1470a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 20:10:41.626396 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:41.625968    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:41.626396 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:41.626071    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krvb4" podUID="b862641e-a55e-42c3-a151-944fd0c1470a"
May 27 20:10:42.336320 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.336294    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-19.ec2.internal" event="NodeReady"
May 27 20:10:42.336498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.336428    2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 20:10:42.373466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.373434    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"]
May 27 20:10:42.391546 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.391517    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:10:42.391686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.391672    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.394446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.394242    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 27 20:10:42.394446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.394309    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 27 20:10:42.394446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.394329    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8k9v9\""
May 27 20:10:42.415546 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.415519    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-745k4"]
May 27 20:10:42.415752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.415685    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.418132 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.418108    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 20:10:42.418132 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.418124    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 20:10:42.418469 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.418452    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w9tq7\""
May 27 20:10:42.418551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.418513    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 20:10:42.424917 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.424899    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 20:10:42.439565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.439547    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"]
May 27 20:10:42.439565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.439570    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:10:42.439728 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.439580    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d29x4"]
May 27 20:10:42.439781 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.439721    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.442293 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.442276    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcb8v\""
May 27 20:10:42.442431 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.442414    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 20:10:42.442492 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.442417    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 20:10:42.463596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.463579    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-745k4"]
May 27 20:10:42.463681 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.463603    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d29x4"]
May 27 20:10:42.463723 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.463683    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.466074 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.466053    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 20:10:42.466191 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.466176    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 20:10:42.466258 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.466176    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cdq7w\""
May 27 20:10:42.466318 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.466302    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 20:10:42.483368 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483445 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483445 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483445 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.483538 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483538 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.483596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9c7d\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.483686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.483641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584005 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.583979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b709e35c-f5ae-4f15-9508-53bc681eea79-config-volume\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.584107 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584021    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584107 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584068    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584107 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584098    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584107 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.584105    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:42.584297 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.584119    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:42.584297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.584297 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.584178    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:43.084160904 +0000 UTC m=+36.075532743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:42.584297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2slc\" (UniqueName: \"kubernetes.io/projected/19d8c15c-e30c-4392-b34c-2e6269398ad4-kube-api-access-z2slc\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.584297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584274    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584301    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584342    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntqsj\" (UniqueName: \"kubernetes.io/projected/b709e35c-f5ae-4f15-9508-53bc681eea79-kube-api-access-ntqsj\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584416    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b709e35c-f5ae-4f15-9508-53bc681eea79-tmp-dir\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584507    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584513    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.584953 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584576    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9c7d\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584953 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.584587    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:42.584953 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.584609    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.584953 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.584645    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:10:43.084629231 +0000 UTC m=+36.076001099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:42.585129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.585090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:42.585129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.585112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.585745 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.585724    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.588613 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.588565    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.588703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.588658    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.594313 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.593936    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.594833 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.594811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9c7d\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:42.625693 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.625674    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:10:42.628443 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.628423    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpcfj\""
May 27 20:10:42.628736 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.628422    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 20:10:42.685400 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685376    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b709e35c-f5ae-4f15-9508-53bc681eea79-config-volume\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685500 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685425    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685500 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685454    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2slc\" (UniqueName: \"kubernetes.io/projected/19d8c15c-e30c-4392-b34c-2e6269398ad4-kube-api-access-z2slc\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.685615 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685504    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqsj\" (UniqueName: \"kubernetes.io/projected/b709e35c-f5ae-4f15-9508-53bc681eea79-kube-api-access-ntqsj\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685615 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685531    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.685615 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.685550    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:42.685615 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.685605    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:43.185588118 +0000 UTC m=+36.176959957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:42.685801 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685557    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b709e35c-f5ae-4f15-9508-53bc681eea79-tmp-dir\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685856 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685842    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b709e35c-f5ae-4f15-9508-53bc681eea79-tmp-dir\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685916 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.685901    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b709e35c-f5ae-4f15-9508-53bc681eea79-config-volume\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:42.685966 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.685932    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:42.686014 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:42.685998    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:43.185981807 +0000 UTC m=+36.177353673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:42.696163 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.696145    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2slc\" (UniqueName: \"kubernetes.io/projected/19d8c15c-e30c-4392-b34c-2e6269398ad4-kube-api-access-z2slc\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:42.696509 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:42.696488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntqsj\" (UniqueName: \"kubernetes.io/projected/b709e35c-f5ae-4f15-9508-53bc681eea79-kube-api-access-ntqsj\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:43.089729 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.089699    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:43.089891 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.089802    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:43.089943 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.089882    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:43.089943 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.089906    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:43.089943 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.089925    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:43.090062 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.089972    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:44.089951725 +0000 UTC m=+37.081323570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:43.090062 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.089990    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:10:44.089980904 +0000 UTC m=+37.081352740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:43.190690 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.190660    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:43.190855 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.190713    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:43.190855 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.190801    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:43.190855 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.190810    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:43.191044 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.190869    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:44.190849043 +0000 UTC m=+37.182220882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:43.191044 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:43.190890    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:44.190880036 +0000 UTC m=+37.182251873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:43.628361 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.628326    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:10:43.631103 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.631079    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 20:10:43.631679 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.631382    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 20:10:43.631679 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:43.631405    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxxwq\""
May 27 20:10:44.098737 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:44.098701    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:44.098911 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:44.098791    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:44.098911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.098902    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:44.098989 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.098913    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:44.098989 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.098956    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:46.098943691 +0000 UTC m=+39.090315525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:44.099360 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.099320    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:44.099485 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.099400    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:10:46.099383201 +0000 UTC m=+39.090755057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:44.199456 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:44.199433    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:44.199757 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:44.199534    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:44.200077 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.200057    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:44.200182 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.200122    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:46.20010215 +0000 UTC m=+39.191473984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:44.200291 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.200275    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:44.200359 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:44.200335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:46.20032048 +0000 UTC m=+39.191692315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:46.117613 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.117486    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.117614    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.117652    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.117672    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:10:50.117657028 +0000 UTC m=+43.109028864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.117716    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.117726    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:46.117911 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.117766    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:50.117750895 +0000 UTC m=+43.109122743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:46.218129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.218043    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:46.218129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.218092    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:46.218267 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.218197    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:46.218267 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.218225    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:46.218267 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.218258    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:50.218245861 +0000 UTC m=+43.209617696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:46.218376 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:46.218293    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:50.218273763 +0000 UTC m=+43.209645601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:46.748603 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.748570    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="2b456544914983d4dbc50c8b5a55795e399dc1a185671a0a59f6d180483ac72f" exitCode=0
May 27 20:10:46.748773 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:46.748622    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"2b456544914983d4dbc50c8b5a55795e399dc1a185671a0a59f6d180483ac72f"}
May 27 20:10:47.751983 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:47.751956    2565 generic.go:358] "Generic (PLEG): container finished" podID="a0e7422f-c7ed-4abd-9ad7-055fcc824cfb" containerID="37b0524745b720f292fb36d36541cd359e6ed0c9208b1f621ff8878753a67ee3" exitCode=0
May 27 20:10:47.752376 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:47.752018    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerDied","Data":"37b0524745b720f292fb36d36541cd359e6ed0c9208b1f621ff8878753a67ee3"}
May 27 20:10:48.756108 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:48.756078    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r75cn" event={"ID":"a0e7422f-c7ed-4abd-9ad7-055fcc824cfb","Type":"ContainerStarted","Data":"07ec71bcf54e5486eae25801e707ff655696bc0605f7917ab9312d7aa68e6b80"}
May 27 20:10:48.784164 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:48.784123    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r75cn" podStartSLOduration=6.107320585 podStartE2EDuration="41.784109796s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:10:10.340837709 +0000 UTC m=+3.332209546" lastFinishedPulling="2026-05-27 20:10:46.017626923 +0000 UTC m=+39.008998757" observedRunningTime="2026-05-27 20:10:48.783764124 +0000 UTC m=+41.775135978" watchObservedRunningTime="2026-05-27 20:10:48.784109796 +0000 UTC m=+41.775481652"
May 27 20:10:50.146250 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:50.146226    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:50.146268    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.146333    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.146342    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.146386    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.146408    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:58.146394559 +0000 UTC m=+51.137766394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:50.146605 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.146441    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:10:58.146425553 +0000 UTC m=+51.137797403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:50.246658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:50.246635    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:50.246724 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:50.246671    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:50.246766 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.246753    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:50.246766 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.246763    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:50.246836 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.246793    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:58.246781526 +0000 UTC m=+51.238153360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:50.246836 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:50.246805    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:10:58.246799441 +0000 UTC m=+51.238171275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:57.645054 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.645024    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bw8lp"]
May 27 20:10:57.647554 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.647538    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.650409 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.650392    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 20:10:57.656853 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.656829    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bw8lp"]
May 27 20:10:57.794033 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.794009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f2bbff-8b69-442e-8d09-66e0ddc036db-original-pull-secret\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.794124 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.794080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-kubelet-config\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.794124 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.794097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-dbus\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.894800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.894778    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-kubelet-config\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.894879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.894804    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-dbus\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.894879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.894844    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f2bbff-8b69-442e-8d09-66e0ddc036db-original-pull-secret\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.894942 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.894892    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-kubelet-config\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.894999 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.894984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f2bbff-8b69-442e-8d09-66e0ddc036db-dbus\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.897630 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.897596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f2bbff-8b69-442e-8d09-66e0ddc036db-original-pull-secret\") pod \"global-pull-secret-syncer-bw8lp\" (UID: \"25f2bbff-8b69-442e-8d09-66e0ddc036db\") " pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:57.955993 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:57.955964    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bw8lp"
May 27 20:10:58.082700 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.082675    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bw8lp"]
May 27 20:10:58.197169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.197120    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:10:58.197169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.197164    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:10:58.197340 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.197268    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:10:58.197340 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.197267    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:10:58.197340 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.197278    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:10:58.197340 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.197325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:14.197312148 +0000 UTC m=+67.188683982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:10:58.197340 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.197336    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:11:14.197330874 +0000 UTC m=+67.188702708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:10:58.298064 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.298041    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:10:58.298152 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.298080    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:10:58.298196 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.298164    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:10:58.298196 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.298187    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:10:58.298261 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.298203    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:14.298191747 +0000 UTC m=+67.289563581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:10:58.298261 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:10:58.298225    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:14.298213424 +0000 UTC m=+67.289585258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:10:58.772887 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:10:58.772855    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bw8lp" event={"ID":"25f2bbff-8b69-442e-8d09-66e0ddc036db","Type":"ContainerStarted","Data":"d2c9478a152527d7c0493f6b0d643f6612ff77ec9fe9cd3186222025ccb5de64"}
May 27 20:11:02.784924 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:02.784880    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bw8lp" event={"ID":"25f2bbff-8b69-442e-8d09-66e0ddc036db","Type":"ContainerStarted","Data":"42484faf496309b6c36af850bb563a9e338638ede5fbadfe1b74b63d4d4c5790"}
May 27 20:11:02.800506 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:02.800462    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bw8lp" podStartSLOduration=1.2761246609999999 podStartE2EDuration="5.800450373s" podCreationTimestamp="2026-05-27 20:10:57 +0000 UTC" firstStartedPulling="2026-05-27 20:10:58.087387198 +0000 UTC m=+51.078759033" lastFinishedPulling="2026-05-27 20:11:02.611712896 +0000 UTC m=+55.603084745" observedRunningTime="2026-05-27 20:11:02.800152243 +0000 UTC m=+55.791524099" watchObservedRunningTime="2026-05-27 20:11:02.800450373 +0000 UTC m=+55.791822229"
May 27 20:11:07.742317 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:07.742294    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrv7s"
May 27 20:11:13.399646 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.399609    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:11:13.400084 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.399697    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:11:13.402411 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.402395    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 20:11:13.402471 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.402396    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 20:11:13.410744 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:13.410729    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 20:11:13.410798 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:13.410788    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:17.410772706 +0000 UTC m=+130.402144541 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : secret "metrics-daemon-secret" not found
May 27 20:11:13.412751 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.412734    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 20:11:13.423808 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.423783    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vjgr\" (UniqueName: \"kubernetes.io/projected/b862641e-a55e-42c3-a151-944fd0c1470a-kube-api-access-2vjgr\") pod \"network-check-target-krvb4\" (UID: \"b862641e-a55e-42c3-a151-944fd0c1470a\") " pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:11:13.640953 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.640933    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kxxwq\""
May 27 20:11:13.649133 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.649117    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:11:13.773897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.773867    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krvb4"]
May 27 20:11:13.776577 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:11:13.776553    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb862641e_a55e_42c3_a151_944fd0c1470a.slice/crio-70a63b41dbf3520528195fa702d7b0351653142c5b6ee24df5037d731a80c799 WatchSource:0}: Error finding container 70a63b41dbf3520528195fa702d7b0351653142c5b6ee24df5037d731a80c799: Status 404 returned error can't find the container with id 70a63b41dbf3520528195fa702d7b0351653142c5b6ee24df5037d731a80c799
May 27 20:11:13.803394 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:13.803368    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krvb4" event={"ID":"b862641e-a55e-42c3-a151-944fd0c1470a","Type":"ContainerStarted","Data":"70a63b41dbf3520528195fa702d7b0351653142c5b6ee24df5037d731a80c799"}
May 27 20:11:14.205400 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:14.205372    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:11:14.205500 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:14.205437    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:11:14.205539 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.205504    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:11:14.205539 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.205519    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:11:14.205539 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.205520    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:11:14.205628 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.205565    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:11:46.205552569 +0000 UTC m=+99.196924408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:11:14.205628 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.205578    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:46.205572004 +0000 UTC m=+99.196943838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:11:14.305805 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:14.305779    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:11:14.305887 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:14.305836    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:11:14.305922 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.305901    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:11:14.305922 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.305903    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:11:14.305977 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.305937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:46.305927207 +0000 UTC m=+99.297299042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:11:14.305977 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:14.305954    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:11:46.305942344 +0000 UTC m=+99.297314182 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:11:17.815527 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:17.815503    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krvb4" event={"ID":"b862641e-a55e-42c3-a151-944fd0c1470a","Type":"ContainerStarted","Data":"262ec38bc7b17feadc504916f71b23cbe883f13a3a7a5fe0c16c8231e342b278"}
May 27 20:11:17.815801 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:17.815588    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:11:17.830357 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:17.830307    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-krvb4" podStartSLOduration=67.556648108 podStartE2EDuration="1m10.830296964s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:11:13.77829534 +0000 UTC m=+66.769667178" lastFinishedPulling="2026-05-27 20:11:17.051944196 +0000 UTC m=+70.043316034" observedRunningTime="2026-05-27 20:11:17.829906109 +0000 UTC m=+70.821277967" watchObservedRunningTime="2026-05-27 20:11:17.830296964 +0000 UTC m=+70.821668819"
May 27 20:11:46.242546 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:46.242448    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:46.242563    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.242642    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.242652    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.242659    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55964b8cfd-8n2lq: secret "image-registry-tls" not found
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.242722    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert podName:98651f5a-36f8-4047-8e1e-2c7e3ab71c5d nodeName:}" failed. No retries permitted until 2026-05-27 20:12:50.242703684 +0000 UTC m=+163.234075531 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-j775g" (UID: "98651f5a-36f8-4047-8e1e-2c7e3ab71c5d") : secret "networking-console-plugin-cert" not found
May 27 20:11:46.242935 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.242738    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls podName:d6c42279-c7d8-4653-90d2-895f6312deb4 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:50.242732146 +0000 UTC m=+163.234103980 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls") pod "image-registry-55964b8cfd-8n2lq" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4") : secret "image-registry-tls" not found
May 27 20:11:46.343849 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:46.343815    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:11:46.343960 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:46.343913    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:11:46.343998 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.343960    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 20:11:46.344029 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.344004    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 20:11:46.344029 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.344025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert podName:19d8c15c-e30c-4392-b34c-2e6269398ad4 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:50.344009985 +0000 UTC m=+163.335381820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert") pod "ingress-canary-d29x4" (UID: "19d8c15c-e30c-4392-b34c-2e6269398ad4") : secret "canary-serving-cert" not found
May 27 20:11:46.344092 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:11:46.344046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls podName:b709e35c-f5ae-4f15-9508-53bc681eea79 nodeName:}" failed. No retries permitted until 2026-05-27 20:12:50.34403496 +0000 UTC m=+163.335406799 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls") pod "dns-default-745k4" (UID: "b709e35c-f5ae-4f15-9508-53bc681eea79") : secret "dns-default-metrics-tls" not found
May 27 20:11:48.820015 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:11:48.819987    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-krvb4"
May 27 20:12:17.471013 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:17.470971    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:12:17.471513 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:17.471119    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 20:12:17.471513 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:17.471183    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs podName:e2ca65ad-7d95-411a-b130-837842fb0836 nodeName:}" failed. No retries permitted until 2026-05-27 20:14:19.471166175 +0000 UTC m=+252.462538010 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs") pod "network-metrics-daemon-89b9c" (UID: "e2ca65ad-7d95-411a-b130-837842fb0836") : secret "metrics-daemon-secret" not found
May 27 20:12:32.291360 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.291321    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"]
May 27 20:12:32.294296 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.294276    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"]
May 27 20:12:32.294454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.294431    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"
May 27 20:12:32.296921 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.296900    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8st8d\""
May 27 20:12:32.297017 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.297002    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.299286 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.299270    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 27 20:12:32.299473 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.299452    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hscq8\""
May 27 20:12:32.299748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.299730    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 27 20:12:32.299869 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.299731    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 27 20:12:32.300014 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.300000    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 27 20:12:32.303498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.303476    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"]
May 27 20:12:32.304163 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.304144    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"]
May 27 20:12:32.378987 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.378957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67500b68-cea1-4aef-9241-d52b8f5b718b-serving-cert\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.379134 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.379013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67500b68-cea1-4aef-9241-d52b8f5b718b-config\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.379134 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.379060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jtpw\" (UniqueName: \"kubernetes.io/projected/f0add050-feab-453e-90fc-f6088d733932-kube-api-access-9jtpw\") pod \"network-check-source-7f44b6dd87-hr9j4\" (UID: \"f0add050-feab-453e-90fc-f6088d733932\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"
May 27 20:12:32.379134 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.379093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7n8\" (UniqueName: \"kubernetes.io/projected/67500b68-cea1-4aef-9241-d52b8f5b718b-kube-api-access-4k7n8\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.479716 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.479667    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67500b68-cea1-4aef-9241-d52b8f5b718b-serving-cert\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.479888 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.479742    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67500b68-cea1-4aef-9241-d52b8f5b718b-config\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.479888 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.479767    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jtpw\" (UniqueName: \"kubernetes.io/projected/f0add050-feab-453e-90fc-f6088d733932-kube-api-access-9jtpw\") pod \"network-check-source-7f44b6dd87-hr9j4\" (UID: \"f0add050-feab-453e-90fc-f6088d733932\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"
May 27 20:12:32.479888 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.479799    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7n8\" (UniqueName: \"kubernetes.io/projected/67500b68-cea1-4aef-9241-d52b8f5b718b-kube-api-access-4k7n8\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.480398 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.480335    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67500b68-cea1-4aef-9241-d52b8f5b718b-config\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.482026 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.482008    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67500b68-cea1-4aef-9241-d52b8f5b718b-serving-cert\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.488554 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.488536    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7n8\" (UniqueName: \"kubernetes.io/projected/67500b68-cea1-4aef-9241-d52b8f5b718b-kube-api-access-4k7n8\") pod \"service-ca-operator-57b5b68b8-8xz82\" (UID: \"67500b68-cea1-4aef-9241-d52b8f5b718b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.488790 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.488769    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jtpw\" (UniqueName: \"kubernetes.io/projected/f0add050-feab-453e-90fc-f6088d733932-kube-api-access-9jtpw\") pod \"network-check-source-7f44b6dd87-hr9j4\" (UID: \"f0add050-feab-453e-90fc-f6088d733932\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"
May 27 20:12:32.604394 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.604269    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"
May 27 20:12:32.611017 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.610992    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"
May 27 20:12:32.727102 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.727069    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4"]
May 27 20:12:32.729755 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:32.729721    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0add050_feab_453e_90fc_f6088d733932.slice/crio-62e06c8278a17c9d64f1f62fb622d80d070410e2aed6326639b581afb2c39afc WatchSource:0}: Error finding container 62e06c8278a17c9d64f1f62fb622d80d070410e2aed6326639b581afb2c39afc: Status 404 returned error can't find the container with id 62e06c8278a17c9d64f1f62fb622d80d070410e2aed6326639b581afb2c39afc
May 27 20:12:32.745178 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.744284    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82"]
May 27 20:12:32.748949 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:32.748927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67500b68_cea1_4aef_9241_d52b8f5b718b.slice/crio-19f84a3525e5ad135df4e51969dd1cb355966b83499efd7a7affac69f57d949e WatchSource:0}: Error finding container 19f84a3525e5ad135df4e51969dd1cb355966b83499efd7a7affac69f57d949e: Status 404 returned error can't find the container with id 19f84a3525e5ad135df4e51969dd1cb355966b83499efd7a7affac69f57d949e
May 27 20:12:32.949587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.949494    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4" event={"ID":"f0add050-feab-453e-90fc-f6088d733932","Type":"ContainerStarted","Data":"24ab9b029981a7ba99bc616a918791f29cad4208f298ef681dea68e5a5d6e5b1"}
May 27 20:12:32.949587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.949540    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4" event={"ID":"f0add050-feab-453e-90fc-f6088d733932","Type":"ContainerStarted","Data":"62e06c8278a17c9d64f1f62fb622d80d070410e2aed6326639b581afb2c39afc"}
May 27 20:12:32.950518 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.950496    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82" event={"ID":"67500b68-cea1-4aef-9241-d52b8f5b718b","Type":"ContainerStarted","Data":"19f84a3525e5ad135df4e51969dd1cb355966b83499efd7a7affac69f57d949e"}
May 27 20:12:32.964969 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:32.964936    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-hr9j4" podStartSLOduration=0.964923697 podStartE2EDuration="964.923697ms" podCreationTimestamp="2026-05-27 20:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:12:32.964462058 +0000 UTC m=+145.955833913" watchObservedRunningTime="2026-05-27 20:12:32.964923697 +0000 UTC m=+145.956295552"
May 27 20:12:34.955606 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:34.955522    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82" event={"ID":"67500b68-cea1-4aef-9241-d52b8f5b718b","Type":"ContainerStarted","Data":"d7959f6cb0c451a1ee33438d9562950da892ae94010726f902583c1dcd24a06b"}
May 27 20:12:34.971637 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:34.971592    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82" podStartSLOduration=1.020395179 podStartE2EDuration="2.971576497s" podCreationTimestamp="2026-05-27 20:12:32 +0000 UTC" firstStartedPulling="2026-05-27 20:12:32.751002604 +0000 UTC m=+145.742374438" lastFinishedPulling="2026-05-27 20:12:34.702183908 +0000 UTC m=+147.693555756" observedRunningTime="2026-05-27 20:12:34.971145309 +0000 UTC m=+147.962517164" watchObservedRunningTime="2026-05-27 20:12:34.971576497 +0000 UTC m=+147.962948355"
May 27 20:12:40.178315 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:40.178287    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5zqm_b4a3cc56-1f86-42a9-bd25-ca35760c5f27/dns-node-resolver/0.log"
May 27 20:12:40.977944 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:40.977916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgcm7_c37a2e35-1576-4b24-bb4f-3690318cefd9/node-ca/0.log"
May 27 20:12:45.403505 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:45.403462    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g" podUID="98651f5a-36f8-4047-8e1e-2c7e3ab71c5d"
May 27 20:12:45.425595 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:45.425563    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4"
May 27 20:12:45.448887 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:45.448862    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-745k4" podUID="b709e35c-f5ae-4f15-9508-53bc681eea79"
May 27 20:12:45.471575 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:45.471540    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-d29x4" podUID="19d8c15c-e30c-4392-b34c-2e6269398ad4"
May 27 20:12:45.634627 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:12:45.634588    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-89b9c" podUID="e2ca65ad-7d95-411a-b130-837842fb0836"
May 27 20:12:45.976732 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:45.976706    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-745k4"
May 27 20:12:45.976872 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:45.976735    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:12:45.976928 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:45.976895    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:12:50.314392 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.314329    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:12:50.314782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.314442    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:12:50.316936 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.316907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"image-registry-55964b8cfd-8n2lq\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") " pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:12:50.317043 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.316907    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98651f5a-36f8-4047-8e1e-2c7e3ab71c5d-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-j775g\" (UID: \"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:12:50.415558 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.415522    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:12:50.415806 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.415574    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:12:50.417921 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.417897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b709e35c-f5ae-4f15-9508-53bc681eea79-metrics-tls\") pod \"dns-default-745k4\" (UID: \"b709e35c-f5ae-4f15-9508-53bc681eea79\") " pod="openshift-dns/dns-default-745k4"
May 27 20:12:50.418042 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.418025    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d8c15c-e30c-4392-b34c-2e6269398ad4-cert\") pod \"ingress-canary-d29x4\" (UID: \"19d8c15c-e30c-4392-b34c-2e6269398ad4\") " pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:12:50.481181 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.481154    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcb8v\""
May 27 20:12:50.481181 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.481154    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w9tq7\""
May 27 20:12:50.481365 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.481160    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8k9v9\""
May 27 20:12:50.487563 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.487545    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-745k4"
May 27 20:12:50.487604 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.487591    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"
May 27 20:12:50.487635 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.487553    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:12:50.628628 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.628502    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-j775g"]
May 27 20:12:50.634525 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:50.634491    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98651f5a_36f8_4047_8e1e_2c7e3ab71c5d.slice/crio-c9c81c23fb5096713a3c6d091b68f80c99806e0aae61f74eaa552943608cf2e3 WatchSource:0}: Error finding container c9c81c23fb5096713a3c6d091b68f80c99806e0aae61f74eaa552943608cf2e3: Status 404 returned error can't find the container with id c9c81c23fb5096713a3c6d091b68f80c99806e0aae61f74eaa552943608cf2e3
May 27 20:12:50.662669 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.662639    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:12:50.665333 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:50.665310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c42279_c7d8_4653_90d2_895f6312deb4.slice/crio-2f4f8426898308755664e3cce882518b6caf912fd9aa32407bdfd33e81404c82 WatchSource:0}: Error finding container 2f4f8426898308755664e3cce882518b6caf912fd9aa32407bdfd33e81404c82: Status 404 returned error can't find the container with id 2f4f8426898308755664e3cce882518b6caf912fd9aa32407bdfd33e81404c82
May 27 20:12:50.680033 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.680013    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-745k4"]
May 27 20:12:50.682922 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:50.682902    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb709e35c_f5ae_4f15_9508_53bc681eea79.slice/crio-212fc4147d7e95edf29b1810b82c5b570633f9e21cd1837e39db4471737829c0 WatchSource:0}: Error finding container 212fc4147d7e95edf29b1810b82c5b570633f9e21cd1837e39db4471737829c0: Status 404 returned error can't find the container with id 212fc4147d7e95edf29b1810b82c5b570633f9e21cd1837e39db4471737829c0
May 27 20:12:50.986666 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.986584    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" event={"ID":"d6c42279-c7d8-4653-90d2-895f6312deb4","Type":"ContainerStarted","Data":"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"}
May 27 20:12:50.986666 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.986626    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" event={"ID":"d6c42279-c7d8-4653-90d2-895f6312deb4","Type":"ContainerStarted","Data":"2f4f8426898308755664e3cce882518b6caf912fd9aa32407bdfd33e81404c82"}
May 27 20:12:50.986909 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.986705    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:12:50.987810 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.987782    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g" event={"ID":"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d","Type":"ContainerStarted","Data":"c9c81c23fb5096713a3c6d091b68f80c99806e0aae61f74eaa552943608cf2e3"}
May 27 20:12:50.988757 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:50.988735    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-745k4" event={"ID":"b709e35c-f5ae-4f15-9508-53bc681eea79","Type":"ContainerStarted","Data":"212fc4147d7e95edf29b1810b82c5b570633f9e21cd1837e39db4471737829c0"}
May 27 20:12:51.006790 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:51.006746    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" podStartSLOduration=163.006732793 podStartE2EDuration="2m43.006732793s" podCreationTimestamp="2026-05-27 20:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:12:51.00540869 +0000 UTC m=+163.996780546" watchObservedRunningTime="2026-05-27 20:12:51.006732793 +0000 UTC m=+163.998104643"
May 27 20:12:52.995263 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:52.995226    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g" event={"ID":"98651f5a-36f8-4047-8e1e-2c7e3ab71c5d","Type":"ContainerStarted","Data":"2c72511f47e85a78c34359ee63b4d5f5ea864b3646c33c8198b54a92af03dc7b"}
May 27 20:12:52.996826 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:52.996802    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-745k4" event={"ID":"b709e35c-f5ae-4f15-9508-53bc681eea79","Type":"ContainerStarted","Data":"f57838fe41555425ee1ed921b7b0717dc8f9e0a97478c924fd9a0fbadf9db9cb"}
May 27 20:12:52.996930 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:52.996831    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-745k4" event={"ID":"b709e35c-f5ae-4f15-9508-53bc681eea79","Type":"ContainerStarted","Data":"746bcb1a16c1ae9c43f008471f50bdd48644912e6b5271394910e81249ae600c"}
May 27 20:12:52.996973 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:52.996962    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-745k4"
May 27 20:12:53.012237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:53.012187    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-j775g" podStartSLOduration=156.611840856 podStartE2EDuration="2m38.012174956s" podCreationTimestamp="2026-05-27 20:10:15 +0000 UTC" firstStartedPulling="2026-05-27 20:12:50.636673911 +0000 UTC m=+163.628045745" lastFinishedPulling="2026-05-27 20:12:52.037007998 +0000 UTC m=+165.028379845" observedRunningTime="2026-05-27 20:12:53.01158783 +0000 UTC m=+166.002959687" watchObservedRunningTime="2026-05-27 20:12:53.012174956 +0000 UTC m=+166.003546852"
May 27 20:12:53.029907 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:53.029841    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-745k4" podStartSLOduration=129.674030767 podStartE2EDuration="2m11.029828669s" podCreationTimestamp="2026-05-27 20:10:42 +0000 UTC" firstStartedPulling="2026-05-27 20:12:50.684621375 +0000 UTC m=+163.675993210" lastFinishedPulling="2026-05-27 20:12:52.040419273 +0000 UTC m=+165.031791112" observedRunningTime="2026-05-27 20:12:53.029292111 +0000 UTC m=+166.020663968" watchObservedRunningTime="2026-05-27 20:12:53.029828669 +0000 UTC m=+166.021200525"
May 27 20:12:57.626715 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:57.626628    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:12:59.626198 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:59.626164    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:12:59.629287 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:59.629264    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cdq7w\""
May 27 20:12:59.636598 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:59.636580    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d29x4"
May 27 20:12:59.758279 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:12:59.758248    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d29x4"]
May 27 20:12:59.761995 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:12:59.761965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d8c15c_e30c_4392_b34c_2e6269398ad4.slice/crio-5c7a0ecea7ba39e9d641921d9ffe3a7caab4e3cf5737194f35568e29cd9de553 WatchSource:0}: Error finding container 5c7a0ecea7ba39e9d641921d9ffe3a7caab4e3cf5737194f35568e29cd9de553: Status 404 returned error can't find the container with id 5c7a0ecea7ba39e9d641921d9ffe3a7caab4e3cf5737194f35568e29cd9de553
May 27 20:13:00.017715 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:00.017684    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d29x4" event={"ID":"19d8c15c-e30c-4392-b34c-2e6269398ad4","Type":"ContainerStarted","Data":"5c7a0ecea7ba39e9d641921d9ffe3a7caab4e3cf5737194f35568e29cd9de553"}
May 27 20:13:01.433560 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.433520    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jmmcp"]
May 27 20:13:01.437898 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.437871    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.441930 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.441906    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 20:13:01.442069 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.441987    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 20:13:01.442069 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.442035    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 20:13:01.442069 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.442044    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 20:13:01.442216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.441988    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qb4j\""
May 27 20:13:01.448247 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.448226    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmmcp"]
May 27 20:13:01.498418 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.498387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4f82322-762e-470c-b662-237246658a09-data-volume\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.498703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.498443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4f82322-762e-470c-b662-237246658a09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.498703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.498470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxct\" (UniqueName: \"kubernetes.io/projected/a4f82322-762e-470c-b662-237246658a09-kube-api-access-4hxct\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.498703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.498511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4f82322-762e-470c-b662-237246658a09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.498703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.498542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4f82322-762e-470c-b662-237246658a09-crio-socket\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.550985 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.550952    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-bnqvt"]
May 27 20:13:01.554239 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.554213    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:01.556874 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.556852    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 27 20:13:01.558103 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.558080    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mbrbd\""
May 27 20:13:01.563242 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.563222    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 27 20:13:01.577475 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.577451    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-bnqvt"]
May 27 20:13:01.599467 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599441    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4f82322-762e-470c-b662-237246658a09-data-volume\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.599610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4f82322-762e-470c-b662-237246658a09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.599610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599566    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxct\" (UniqueName: \"kubernetes.io/projected/a4f82322-762e-470c-b662-237246658a09-kube-api-access-4hxct\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.599726 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599626    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4f82322-762e-470c-b662-237246658a09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.599726 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599657    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4f82322-762e-470c-b662-237246658a09-crio-socket\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.599818 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.599807    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4f82322-762e-470c-b662-237246658a09-crio-socket\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.601294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.601227    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4f82322-762e-470c-b662-237246658a09-data-volume\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.601472 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.601428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4f82322-762e-470c-b662-237246658a09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.602312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.602290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4f82322-762e-470c-b662-237246658a09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.618892 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.618859    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxct\" (UniqueName: \"kubernetes.io/projected/a4f82322-762e-470c-b662-237246658a09-kube-api-access-4hxct\") pod \"insights-runtime-extractor-jmmcp\" (UID: \"a4f82322-762e-470c-b662-237246658a09\") " pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.700238 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.700210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwkf\" (UniqueName: \"kubernetes.io/projected/b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454-kube-api-access-dlwkf\") pod \"downloads-57bd96b888-bnqvt\" (UID: \"b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454\") " pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:01.749274 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.749241    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jmmcp"
May 27 20:13:01.801239 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.801202    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwkf\" (UniqueName: \"kubernetes.io/projected/b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454-kube-api-access-dlwkf\") pod \"downloads-57bd96b888-bnqvt\" (UID: \"b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454\") " pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:01.810740 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.810712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwkf\" (UniqueName: \"kubernetes.io/projected/b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454-kube-api-access-dlwkf\") pod \"downloads-57bd96b888-bnqvt\" (UID: \"b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454\") " pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:01.865732 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.865685    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:01.910769 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.910741    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jmmcp"]
May 27 20:13:01.915127 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:01.915095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f82322_762e_470c_b662_237246658a09.slice/crio-bf565feb373c95cc7c3390701d9c51649eb77237c300c48ea3d68e1f30f1e2ac WatchSource:0}: Error finding container bf565feb373c95cc7c3390701d9c51649eb77237c300c48ea3d68e1f30f1e2ac: Status 404 returned error can't find the container with id bf565feb373c95cc7c3390701d9c51649eb77237c300c48ea3d68e1f30f1e2ac
May 27 20:13:01.998450 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:01.998416    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-bnqvt"]
May 27 20:13:02.002502 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:02.002474    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c7b7aa_ceb9_4aca_a853_d2ecfa3f3454.slice/crio-adbe75151b2a70f711696dc7951aaf6bfb3c2f4eb48e08c02f1f2172494eab50 WatchSource:0}: Error finding container adbe75151b2a70f711696dc7951aaf6bfb3c2f4eb48e08c02f1f2172494eab50: Status 404 returned error can't find the container with id adbe75151b2a70f711696dc7951aaf6bfb3c2f4eb48e08c02f1f2172494eab50
May 27 20:13:02.023314 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:02.023287    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-bnqvt" event={"ID":"b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454","Type":"ContainerStarted","Data":"adbe75151b2a70f711696dc7951aaf6bfb3c2f4eb48e08c02f1f2172494eab50"}
May 27 20:13:02.024446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:02.024424    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d29x4" event={"ID":"19d8c15c-e30c-4392-b34c-2e6269398ad4","Type":"ContainerStarted","Data":"bb3265ad690a3d6ef2c4ea3ec43aeb82b40351899f0fa4a069dce0996e403ba8"}
May 27 20:13:02.025612 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:02.025592    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmmcp" event={"ID":"a4f82322-762e-470c-b662-237246658a09","Type":"ContainerStarted","Data":"01ae3d6a8c29e37f1ad9c8f90140a7455bc30362e7e48a0910b853b73525ec11"}
May 27 20:13:02.025612 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:02.025614    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmmcp" event={"ID":"a4f82322-762e-470c-b662-237246658a09","Type":"ContainerStarted","Data":"bf565feb373c95cc7c3390701d9c51649eb77237c300c48ea3d68e1f30f1e2ac"}
May 27 20:13:02.042692 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:02.042649    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d29x4" podStartSLOduration=138.150672076 podStartE2EDuration="2m20.042639246s" podCreationTimestamp="2026-05-27 20:10:42 +0000 UTC" firstStartedPulling="2026-05-27 20:12:59.764048906 +0000 UTC m=+172.755420747" lastFinishedPulling="2026-05-27 20:13:01.65601608 +0000 UTC m=+174.647387917" observedRunningTime="2026-05-27 20:13:02.04207504 +0000 UTC m=+175.033446897" watchObservedRunningTime="2026-05-27 20:13:02.042639246 +0000 UTC m=+175.034011102"
May 27 20:13:03.001686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.001651    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-745k4"
May 27 20:13:03.030608 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.030455    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmmcp" event={"ID":"a4f82322-762e-470c-b662-237246658a09","Type":"ContainerStarted","Data":"db99fb1fcde6495c7a499dd710a53aee991b83718f9355dc9c30bf97a8f5f7d7"}
May 27 20:13:03.900798 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.900756    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:03.905388 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.905361    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909576    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909605    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909631    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909635    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909582    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vktpf\""
May 27 20:13:03.909762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.909577    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 27 20:13:03.913865 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:03.913844    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:04.019302 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.019624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.019624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.019624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.019624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.019624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.019602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp8xf\" (UniqueName: \"kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.035848 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.035820    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jmmcp" event={"ID":"a4f82322-762e-470c-b662-237246658a09","Type":"ContainerStarted","Data":"d59a58ff7181988db97773145e857ac9ad12b26f47070ed32624d254fcd3c229"}
May 27 20:13:04.053876 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.053831    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jmmcp" podStartSLOduration=1.06081764 podStartE2EDuration="3.053816365s" podCreationTimestamp="2026-05-27 20:13:01 +0000 UTC" firstStartedPulling="2026-05-27 20:13:01.971296505 +0000 UTC m=+174.962668340" lastFinishedPulling="2026-05-27 20:13:03.964295219 +0000 UTC m=+176.955667065" observedRunningTime="2026-05-27 20:13:04.052833593 +0000 UTC m=+177.044205450" watchObservedRunningTime="2026-05-27 20:13:04.053816365 +0000 UTC m=+177.045188220"
May 27 20:13:04.120292 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120260    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.120479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120299    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.120479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120329    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.120479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120385    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.120479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120439    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.120479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.120468    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp8xf\" (UniqueName: \"kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.121529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.121321    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.121529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.121329    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.121701 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.121647    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.123422 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.123379    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.123838 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.123810    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.129609 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.129558    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp8xf\" (UniqueName: \"kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf\") pod \"console-66b56c4bfd-w9mms\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") " pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.216628 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.216541    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:04.353740 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:04.353708    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:04.356897 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:04.356865    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2103c06a_8cf4_4eb7_9e4f_1220fedcd5ff.slice/crio-3101520ab1d2a31930d3b376ab0edbc803302972f16a07eb004cadc8d197b2ca WatchSource:0}: Error finding container 3101520ab1d2a31930d3b376ab0edbc803302972f16a07eb004cadc8d197b2ca: Status 404 returned error can't find the container with id 3101520ab1d2a31930d3b376ab0edbc803302972f16a07eb004cadc8d197b2ca
May 27 20:13:05.039840 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:05.039801    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56c4bfd-w9mms" event={"ID":"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff","Type":"ContainerStarted","Data":"3101520ab1d2a31930d3b376ab0edbc803302972f16a07eb004cadc8d197b2ca"}
May 27 20:13:09.051806 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.051763    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56c4bfd-w9mms" event={"ID":"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff","Type":"ContainerStarted","Data":"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"}
May 27 20:13:09.070469 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.070410    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-66b56c4bfd-w9mms" podStartSLOduration=1.8819085800000002 podStartE2EDuration="6.070393311s" podCreationTimestamp="2026-05-27 20:13:03 +0000 UTC" firstStartedPulling="2026-05-27 20:13:04.359153674 +0000 UTC m=+177.350525515" lastFinishedPulling="2026-05-27 20:13:08.547638411 +0000 UTC m=+181.539010246" observedRunningTime="2026-05-27 20:13:09.069392315 +0000 UTC m=+182.060764173" watchObservedRunningTime="2026-05-27 20:13:09.070393311 +0000 UTC m=+182.061765168"
May 27 20:13:09.518323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.518245    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"]
May 27 20:13:09.520582 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.520560    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.524879    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.525000    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.525200    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.525296    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.525469    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 20:13:09.525837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.525570    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t26qk\""
May 27 20:13:09.528696 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.528673    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"]
May 27 20:13:09.671637 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.671595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.671813 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.671673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.671874 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.671815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.671874 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.671858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qv9\" (UniqueName: \"kubernetes.io/projected/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-kube-api-access-j2qv9\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.773192 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.773099    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.773192 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.773147    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qv9\" (UniqueName: \"kubernetes.io/projected/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-kube-api-access-j2qv9\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.773440 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.773340    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.773440 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.773413    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.774059 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.774037    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.776075 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.776048    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.776164 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.776121    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.781415 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.781392    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qv9\" (UniqueName: \"kubernetes.io/projected/ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f-kube-api-access-j2qv9\") pod \"prometheus-operator-7779bbdd78-xfpk2\" (UID: \"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.832512 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.832480    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"
May 27 20:13:09.981110 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:09.981085    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2"]
May 27 20:13:09.983191 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:09.983162    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6d0d43_cd5e_45b2_a0c9_4ea5fbdaba2f.slice/crio-2d2e40fb510bdfb9b3907a5d056e8e26f1c2ebd7f6135fb55daa7a477e729b95 WatchSource:0}: Error finding container 2d2e40fb510bdfb9b3907a5d056e8e26f1c2ebd7f6135fb55daa7a477e729b95: Status 404 returned error can't find the container with id 2d2e40fb510bdfb9b3907a5d056e8e26f1c2ebd7f6135fb55daa7a477e729b95
May 27 20:13:10.056387 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:10.056279    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2" event={"ID":"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f","Type":"ContainerStarted","Data":"2d2e40fb510bdfb9b3907a5d056e8e26f1c2ebd7f6135fb55daa7a477e729b95"}
May 27 20:13:10.493623 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:10.493523    2565 patch_prober.go:28] interesting pod/image-registry-55964b8cfd-8n2lq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 20:13:10.493623 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:10.493602    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 20:13:11.996587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:11.996557    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:13:12.064028 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:12.063986    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2" event={"ID":"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f","Type":"ContainerStarted","Data":"42b29c8753df4e0acd89db9cae8c1a5d66cf91b093be2fd200bb0642cc7b27c9"}
May 27 20:13:12.064028 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:12.064029    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2" event={"ID":"ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f","Type":"ContainerStarted","Data":"b0431824eaf0f728512945bdd60400ea468be258e044d0e62b7a37527019c6d2"}
May 27 20:13:12.082467 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:12.082411    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xfpk2" podStartSLOduration=1.860845844 podStartE2EDuration="3.082393284s" podCreationTimestamp="2026-05-27 20:13:09 +0000 UTC" firstStartedPulling="2026-05-27 20:13:09.985127541 +0000 UTC m=+182.976499375" lastFinishedPulling="2026-05-27 20:13:11.206674973 +0000 UTC m=+184.198046815" observedRunningTime="2026-05-27 20:13:12.080678164 +0000 UTC m=+185.072050020" watchObservedRunningTime="2026-05-27 20:13:12.082393284 +0000 UTC m=+185.073765140"
May 27 20:13:13.878946 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.876846    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ds4jd"]
May 27 20:13:13.882377 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.882330    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:13.884921 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.884891    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 20:13:13.885047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.884929    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 20:13:13.885047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.884976    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 20:13:13.885047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:13.884929    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k6ksk\""
May 27 20:13:14.012321 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-wtmp\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpnzb\" (UniqueName: \"kubernetes.io/projected/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-kube-api-access-xpnzb\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-tls\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012568 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012568 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-metrics-client-ca\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012647 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-sys\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012647 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-root\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012734 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.012734 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.012683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-textfile\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113220 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113184    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-textfile\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113236    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-wtmp\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113282    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpnzb\" (UniqueName: \"kubernetes.io/projected/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-kube-api-access-xpnzb\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113335    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-tls\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113382    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113408    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-metrics-client-ca\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113446    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-sys\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-wtmp\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113470    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-root\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113517    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-root\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113540    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.113671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.113593    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-textfile\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.114082 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.114043    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-sys\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.114178 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.114157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.114267 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.114244    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-metrics-client-ca\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.116133 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.116108    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.116594 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.116572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-node-exporter-tls\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.121485 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.121463    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpnzb\" (UniqueName: \"kubernetes.io/projected/ea4e64bf-c5a7-449a-a8c9-f10aec9918e1-kube-api-access-xpnzb\") pod \"node-exporter-ds4jd\" (UID: \"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1\") " pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.193605 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.193520    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ds4jd"
May 27 20:13:14.217606 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.217574    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:14.217750 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.217619    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:14.223401 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.223374    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:14.955541 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.955498    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 20:13:14.960750 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.960724    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964039    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964043    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964091    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964110    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964149    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964043    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964245    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964262    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nz2kf\""
May 27 20:13:14.964300 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.964285    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 27 20:13:14.969697 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.969484    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 27 20:13:14.972442 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:14.972421    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 20:13:15.077466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.077419    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:15.122863 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.122832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszcf\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-kube-api-access-qszcf\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123011 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.122877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123011 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.122899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123011 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.122945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123121 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123121 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-volume\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-out\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123323 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123524 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-web-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.123524 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.123382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224609 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224513    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224609 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224556    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224736    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-volume\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224767    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-out\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224791    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224975 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224834    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224975 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224862    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224975 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224897    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-web-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.224975 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224946    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.225159 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.224987    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qszcf\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-kube-api-access-qszcf\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.225159 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.225105    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.225159 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.225136    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.225307 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.225165    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.226209 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.226101    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.226617 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.226550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.227087 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.227031    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/278f60c7-9f18-440b-907d-f9dc61e5f23b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.228010 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.227964    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-volume\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.228106 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.228021    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.229062 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.229019    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.229155 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.229109    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.229593 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.229575    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/278f60c7-9f18-440b-907d-f9dc61e5f23b-config-out\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.230191 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.230157    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.230458 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.230436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.230618 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.230583    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.230739 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.230719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/278f60c7-9f18-440b-907d-f9dc61e5f23b-web-config\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.234664 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.234642    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszcf\" (UniqueName: \"kubernetes.io/projected/278f60c7-9f18-440b-907d-f9dc61e5f23b-kube-api-access-qszcf\") pod \"alertmanager-main-0\" (UID: \"278f60c7-9f18-440b-907d-f9dc61e5f23b\") " pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.275402 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.275372    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 27 20:13:15.964478 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.964447    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"]
May 27 20:13:15.970995 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.970962    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:15.973646 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973617    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 27 20:13:15.974024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973850    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fm3r0o2dd6lgg\""
May 27 20:13:15.974024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973905    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 27 20:13:15.974024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973934    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 27 20:13:15.974024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973946    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 27 20:13:15.974024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.973967    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bt65s\""
May 27 20:13:15.974310 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.974050    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 27 20:13:15.978282 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:15.978261    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"]
May 27 20:13:16.031956 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.031922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.031956 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.031960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.031988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-grpc-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.032021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.032118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032169 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.032156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032333 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.032180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssb75\" (UniqueName: \"kubernetes.io/projected/0370d9b8-3da3-4501-8237-4b60b9363b4a-kube-api-access-ssb75\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.032333 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.032302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0370d9b8-3da3-4501-8237-4b60b9363b4a-metrics-client-ca\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.132861 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.132818    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.132861 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.132864    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.132886    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssb75\" (UniqueName: \"kubernetes.io/projected/0370d9b8-3da3-4501-8237-4b60b9363b4a-kube-api-access-ssb75\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.132983    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0370d9b8-3da3-4501-8237-4b60b9363b4a-metrics-client-ca\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.133052    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.133095    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.133119    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-grpc-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133340 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.133163    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.133808 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.133769    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0370d9b8-3da3-4501-8237-4b60b9363b4a-metrics-client-ca\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.136027 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.135995    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.136423 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.136371    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.136941 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.136920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-grpc-tls\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.137019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.136988    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.137075 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.137019    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.137194 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.137173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0370d9b8-3da3-4501-8237-4b60b9363b4a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.142254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.142236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssb75\" (UniqueName: \"kubernetes.io/projected/0370d9b8-3da3-4501-8237-4b60b9363b4a-kube-api-access-ssb75\") pod \"thanos-querier-5c59b69d8-8gkfs\" (UID: \"0370d9b8-3da3-4501-8237-4b60b9363b4a\") " pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:16.283188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:16.283148    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:18.226589 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:18.226565    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4e64bf_c5a7_449a_a8c9_f10aec9918e1.slice/crio-f020ebbee5ae8aebbec99b9575a8920b80114b0567195a27b84c4ad4d08085f1 WatchSource:0}: Error finding container f020ebbee5ae8aebbec99b9575a8920b80114b0567195a27b84c4ad4d08085f1: Status 404 returned error can't find the container with id f020ebbee5ae8aebbec99b9575a8920b80114b0567195a27b84c4ad4d08085f1
May 27 20:13:18.238204 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.238174    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6795f97778-l7lgt"]
May 27 20:13:18.244137 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.244071    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.247160 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.247108    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 27 20:13:18.247341 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.247160    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 27 20:13:18.247515 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.247495    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 27 20:13:18.248465 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.248316    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zf9xc\""
May 27 20:13:18.248465 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.248396    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6thvj3kq8p2cg\""
May 27 20:13:18.248666 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.248574    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 27 20:13:18.251517 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-client-certs\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251517 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251517 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-metrics-server-audit-profiles\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251517 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-client-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251811 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8wj\" (UniqueName: \"kubernetes.io/projected/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-kube-api-access-lm8wj\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251811 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-tls\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251811 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-audit-log\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.251946 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.251878    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6795f97778-l7lgt"]
May 27 20:13:18.353108 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.353081    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-client-certs\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.353880    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.353949    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-metrics-server-audit-profiles\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.354008    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-client-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.354036    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8wj\" (UniqueName: \"kubernetes.io/projected/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-kube-api-access-lm8wj\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.354072    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-tls\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.354159    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-audit-log\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.354590    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-audit-log\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.355237 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.355214    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.356265 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.356204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-client-certs\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.356265 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.356253    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-metrics-server-audit-profiles\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.358859 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.358833    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-secret-metrics-server-tls\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.361614 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.361592    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"]
May 27 20:13:18.362949 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.362923    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-client-ca-bundle\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.366253 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:18.366230    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0370d9b8_3da3_4501_8237_4b60b9363b4a.slice/crio-d89c14dbc98aecfabe6c955dee8e100677c7e59d20301704eb87ef9657945661 WatchSource:0}: Error finding container d89c14dbc98aecfabe6c955dee8e100677c7e59d20301704eb87ef9657945661: Status 404 returned error can't find the container with id d89c14dbc98aecfabe6c955dee8e100677c7e59d20301704eb87ef9657945661
May 27 20:13:18.367610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.367587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8wj\" (UniqueName: \"kubernetes.io/projected/fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c-kube-api-access-lm8wj\") pod \"metrics-server-6795f97778-l7lgt\" (UID: \"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c\") " pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.383179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.383150    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 27 20:13:18.391319 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:18.391295    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278f60c7_9f18_440b_907d_f9dc61e5f23b.slice/crio-8a277d91fd58ab0555b145333995cd09eb4f45ab918889547833b94b6fde9cb7 WatchSource:0}: Error finding container 8a277d91fd58ab0555b145333995cd09eb4f45ab918889547833b94b6fde9cb7: Status 404 returned error can't find the container with id 8a277d91fd58ab0555b145333995cd09eb4f45ab918889547833b94b6fde9cb7
May 27 20:13:18.557533 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.557499    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:18.741157 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.741118    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6795f97778-l7lgt"]
May 27 20:13:18.746499 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:18.746470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfaf5d8_2a31_4964_bd7c_2b2cea773e6c.slice/crio-bcbf6dcaa6d9186913523d9b4b5345d5a8850e0a5a90170e4ac08ebb0f59635f WatchSource:0}: Error finding container bcbf6dcaa6d9186913523d9b4b5345d5a8850e0a5a90170e4ac08ebb0f59635f: Status 404 returned error can't find the container with id bcbf6dcaa6d9186913523d9b4b5345d5a8850e0a5a90170e4ac08ebb0f59635f
May 27 20:13:18.764390 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.764006    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"]
May 27 20:13:18.768375 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.767750    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:18.771271 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.771249    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 27 20:13:18.772463 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.772253    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-gvlbc\""
May 27 20:13:18.779842 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.779800    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"]
May 27 20:13:18.863369 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.863176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sbw6w\" (UID: \"0120e3c5-e241-48a9-9ae3-31bf66d86bc9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:18.965285 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:18.964718    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sbw6w\" (UID: \"0120e3c5-e241-48a9-9ae3-31bf66d86bc9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:18.965285 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:13:18.964981    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 27 20:13:18.965285 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:13:18.965049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert podName:0120e3c5-e241-48a9-9ae3-31bf66d86bc9 nodeName:}" failed. No retries permitted until 2026-05-27 20:13:19.465029323 +0000 UTC m=+192.456401158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-sbw6w" (UID: "0120e3c5-e241-48a9-9ae3-31bf66d86bc9") : secret "monitoring-plugin-cert" not found
May 27 20:13:19.089285 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.088217    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-bnqvt" event={"ID":"b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454","Type":"ContainerStarted","Data":"c2b4137162154d91350f8364ed095d7ab18bf4a0175f3513d8f8ccd4da791bde"}
May 27 20:13:19.089285 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.089140    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:19.092199 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.092123    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"d89c14dbc98aecfabe6c955dee8e100677c7e59d20301704eb87ef9657945661"}
May 27 20:13:19.094498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.094469    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-bnqvt"
May 27 20:13:19.095878 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.095827    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt" event={"ID":"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c","Type":"ContainerStarted","Data":"bcbf6dcaa6d9186913523d9b4b5345d5a8850e0a5a90170e4ac08ebb0f59635f"}
May 27 20:13:19.097460 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.097392    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"8a277d91fd58ab0555b145333995cd09eb4f45ab918889547833b94b6fde9cb7"}
May 27 20:13:19.098648 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.098609    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ds4jd" event={"ID":"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1","Type":"ContainerStarted","Data":"f020ebbee5ae8aebbec99b9575a8920b80114b0567195a27b84c4ad4d08085f1"}
May 27 20:13:19.113623 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.113127    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-bnqvt" podStartSLOduration=1.791740489 podStartE2EDuration="18.113110982s" podCreationTimestamp="2026-05-27 20:13:01 +0000 UTC" firstStartedPulling="2026-05-27 20:13:02.004397945 +0000 UTC m=+174.995769782" lastFinishedPulling="2026-05-27 20:13:18.325768437 +0000 UTC m=+191.317140275" observedRunningTime="2026-05-27 20:13:19.111739002 +0000 UTC m=+192.103110858" watchObservedRunningTime="2026-05-27 20:13:19.113110982 +0000 UTC m=+192.104482838"
May 27 20:13:19.471044 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.470952    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sbw6w\" (UID: \"0120e3c5-e241-48a9-9ae3-31bf66d86bc9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:19.474549 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.474504    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0120e3c5-e241-48a9-9ae3-31bf66d86bc9-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-sbw6w\" (UID: \"0120e3c5-e241-48a9-9ae3-31bf66d86bc9\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:19.681104 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:19.681068    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:21.444903 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:21.444824    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"]
May 27 20:13:22.024741 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:13:22.024707    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0120e3c5_e241_48a9_9ae3_31bf66d86bc9.slice/crio-ae30c9b94216b90ab9d0755ca775bcb5a487ce3fc2e5ba6f0869e433e111d73e WatchSource:0}: Error finding container ae30c9b94216b90ab9d0755ca775bcb5a487ce3fc2e5ba6f0869e433e111d73e: Status 404 returned error can't find the container with id ae30c9b94216b90ab9d0755ca775bcb5a487ce3fc2e5ba6f0869e433e111d73e
May 27 20:13:22.110510 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:22.110423    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w" event={"ID":"0120e3c5-e241-48a9-9ae3-31bf66d86bc9","Type":"ContainerStarted","Data":"ae30c9b94216b90ab9d0755ca775bcb5a487ce3fc2e5ba6f0869e433e111d73e"}
May 27 20:13:23.117581 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.117480    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"a83050fd9a87fe2647c5cc5dd9511eadfa0ae17e5f5aea1999c0ad256bacaa78"}
May 27 20:13:23.117581 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.117525    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"a5582aee25d0cf0e8bf49b59d866892fe59ed92c1e39450d545a385ae740b72f"}
May 27 20:13:23.117581 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.117539    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"e21217d994262dca4ee7deff651293b249e31d829b83fdb1094e19ca6a5e77d6"}
May 27 20:13:23.119975 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.119945    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt" event={"ID":"fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c","Type":"ContainerStarted","Data":"f4f480ec5305672e561159df244bef7d1deba70bcab85fd49e1fa883871836ba"}
May 27 20:13:23.121908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.121882    2565 generic.go:358] "Generic (PLEG): container finished" podID="278f60c7-9f18-440b-907d-f9dc61e5f23b" containerID="ecf51768067b1f771366a7b4d8a61c4cf822ba345d2f712eb6ab39d73da35cf2" exitCode=0
May 27 20:13:23.122235 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.122191    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerDied","Data":"ecf51768067b1f771366a7b4d8a61c4cf822ba345d2f712eb6ab39d73da35cf2"}
May 27 20:13:23.125373 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.125286    2565 generic.go:358] "Generic (PLEG): container finished" podID="ea4e64bf-c5a7-449a-a8c9-f10aec9918e1" containerID="b121a6a464d2fe33b69427900285a2da2234c46b03c2dffeea480bd67127700c" exitCode=0
May 27 20:13:23.125472 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.125399    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ds4jd" event={"ID":"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1","Type":"ContainerDied","Data":"b121a6a464d2fe33b69427900285a2da2234c46b03c2dffeea480bd67127700c"}
May 27 20:13:23.184772 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.183808    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt" podStartSLOduration=1.702502157 podStartE2EDuration="5.183786547s" podCreationTimestamp="2026-05-27 20:13:18 +0000 UTC" firstStartedPulling="2026-05-27 20:13:18.749008623 +0000 UTC m=+191.740380577" lastFinishedPulling="2026-05-27 20:13:22.230293129 +0000 UTC m=+195.221664967" observedRunningTime="2026-05-27 20:13:23.141059083 +0000 UTC m=+196.132430945" watchObservedRunningTime="2026-05-27 20:13:23.183786547 +0000 UTC m=+196.175158403"
May 27 20:13:23.595192 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:23.594428    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:13:24.131088 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:24.131000    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ds4jd" event={"ID":"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1","Type":"ContainerStarted","Data":"23ab04715fc9a41bc77cd9a2bb418731561b82dba8b30b125f90e01e4a9f6419"}
May 27 20:13:24.131088 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:24.131045    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ds4jd" event={"ID":"ea4e64bf-c5a7-449a-a8c9-f10aec9918e1","Type":"ContainerStarted","Data":"9c18d840475eb02ccfa620a407fe36accba2324cb403317b241d5bdc6ec4bf98"}
May 27 20:13:24.157452 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:24.156595    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ds4jd" podStartSLOduration=8.110057469 podStartE2EDuration="11.156574898s" podCreationTimestamp="2026-05-27 20:13:13 +0000 UTC" firstStartedPulling="2026-05-27 20:13:18.228875785 +0000 UTC m=+191.220247622" lastFinishedPulling="2026-05-27 20:13:21.275393205 +0000 UTC m=+194.266765051" observedRunningTime="2026-05-27 20:13:24.149960022 +0000 UTC m=+197.141331878" watchObservedRunningTime="2026-05-27 20:13:24.156574898 +0000 UTC m=+197.147946754"
May 27 20:13:25.139180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.137176    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w" event={"ID":"0120e3c5-e241-48a9-9ae3-31bf66d86bc9","Type":"ContainerStarted","Data":"ec87c2b0f52d77a87031675fc475469fafb56a11b05a0c69cb6d2046928d1ff8"}
May 27 20:13:25.139180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.137683    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:25.144155 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.144089    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"ee7dc6474dfe9b05b09c2f97ee29abb67f01705700286560b8a5152c68b20c6e"}
May 27 20:13:25.144307 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.144287    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"5cde5f44131e740caa1bb4b01f35cf4d152af682e6f8e4b9b3a04ddec165e387"}
May 27 20:13:25.144662 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.144623    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w"
May 27 20:13:25.144662 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.144646    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" event={"ID":"0370d9b8-3da3-4501-8237-4b60b9363b4a","Type":"ContainerStarted","Data":"19edd7273196e8a1b17fce11f3679fa3d204e3b2c224cecf4817d51f92cc1ced"}
May 27 20:13:25.156967 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.156925    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-sbw6w" podStartSLOduration=4.802785841 podStartE2EDuration="7.156908907s" podCreationTimestamp="2026-05-27 20:13:18 +0000 UTC" firstStartedPulling="2026-05-27 20:13:22.225920099 +0000 UTC m=+195.217291937" lastFinishedPulling="2026-05-27 20:13:24.580043156 +0000 UTC m=+197.571415003" observedRunningTime="2026-05-27 20:13:25.156405405 +0000 UTC m=+198.147777263" watchObservedRunningTime="2026-05-27 20:13:25.156908907 +0000 UTC m=+198.148280764"
May 27 20:13:25.184566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:25.184516    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs" podStartSLOduration=3.969902232 podStartE2EDuration="10.184498815s" podCreationTimestamp="2026-05-27 20:13:15 +0000 UTC" firstStartedPulling="2026-05-27 20:13:18.368142322 +0000 UTC m=+191.359514157" lastFinishedPulling="2026-05-27 20:13:24.5827389 +0000 UTC m=+197.574110740" observedRunningTime="2026-05-27 20:13:25.182811899 +0000 UTC m=+198.174183757" watchObservedRunningTime="2026-05-27 20:13:25.184498815 +0000 UTC m=+198.175870673"
May 27 20:13:26.149738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:26.149699    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"dff19a96a490707711c52af51d979bbd59e99c593d7ef50e735c40f2cea3ac71"}
May 27 20:13:26.150276 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:26.150255    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:27.156689 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.156647    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"f8411ae6e76af6bc7dbb639e4f4e792358cf0bb4dbff74bc0994112d15f7e5c8"}
May 27 20:13:27.157167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.156715    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"ae7bab8b1eefc9389670208970b5aa5b8b2c44f43b399ec0925529c5889f965f"}
May 27 20:13:27.157167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.156730    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"ee9580da53d1299631b3728afeb5d9cb1a8917a9b3d29bb68a62c324a414495a"}
May 27 20:13:27.157167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.156744    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"ad957b5d094da629aedf6ee6a0e02b485bfd90378867ddd7854672bb40c27199"}
May 27 20:13:27.157167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.156752    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"278f60c7-9f18-440b-907d-f9dc61e5f23b","Type":"ContainerStarted","Data":"b06b2a6d14b318df542c261da9581e4cb4bf4b94b54d8c086094f5d69ebbf9e8"}
May 27 20:13:27.163579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.163558    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c59b69d8-8gkfs"
May 27 20:13:27.185525 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:27.185472    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.667964873 podStartE2EDuration="13.18545531s" podCreationTimestamp="2026-05-27 20:13:14 +0000 UTC" firstStartedPulling="2026-05-27 20:13:18.393359924 +0000 UTC m=+191.384731772" lastFinishedPulling="2026-05-27 20:13:25.910850364 +0000 UTC m=+198.902222209" observedRunningTime="2026-05-27 20:13:27.183062711 +0000 UTC m=+200.174434569" watchObservedRunningTime="2026-05-27 20:13:27.18545531 +0000 UTC m=+200.176827168"
May 27 20:13:30.850752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:30.850718    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:38.558291 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:38.558256    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:38.558766 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:38.558306    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:45.205984 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:45.205951    2565 generic.go:358] "Generic (PLEG): container finished" podID="67500b68-cea1-4aef-9241-d52b8f5b718b" containerID="d7959f6cb0c451a1ee33438d9562950da892ae94010726f902583c1dcd24a06b" exitCode=0
May 27 20:13:45.206463 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:45.206024    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82" event={"ID":"67500b68-cea1-4aef-9241-d52b8f5b718b","Type":"ContainerDied","Data":"d7959f6cb0c451a1ee33438d9562950da892ae94010726f902583c1dcd24a06b"}
May 27 20:13:45.206463 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:45.206452    2565 scope.go:117] "RemoveContainer" containerID="d7959f6cb0c451a1ee33438d9562950da892ae94010726f902583c1dcd24a06b"
May 27 20:13:46.209999 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:46.209917    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-8xz82" event={"ID":"67500b68-cea1-4aef-9241-d52b8f5b718b","Type":"ContainerStarted","Data":"6a4220bd131a03430cb67c62f60029895aa4d783ec13d2386f2eb537c9824f4c"}
May 27 20:13:48.624386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:48.624297    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerName="registry" containerID="cri-o://dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919" gracePeriod=30
May 27 20:13:48.878797 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:48.878745    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:13:49.038845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038808    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038867    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038892    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038927    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9c7d\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038945    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038961    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.038992    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.039026    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration\") pod \"d6c42279-c7d8-4653-90d2-895f6312deb4\" (UID: \"d6c42279-c7d8-4653-90d2-895f6312deb4\") "
May 27 20:13:49.039383 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.039292    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:13:49.039447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.039400    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:13:49.041746 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.041696    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:13:49.041746 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.041736    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:13:49.041912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.041818    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:13:49.041912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.041849    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d" (OuterVolumeSpecName: "kube-api-access-r9c7d") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "kube-api-access-r9c7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:13:49.041912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.041878    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:13:49.047779 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.047756    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6c42279-c7d8-4653-90d2-895f6312deb4" (UID: "d6c42279-c7d8-4653-90d2-895f6312deb4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140465    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-trusted-ca\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140491    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-certificates\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140503    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6c42279-c7d8-4653-90d2-895f6312deb4-ca-trust-extracted\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140511    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9c7d\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-kube-api-access-r9c7d\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140520    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-installation-pull-secrets\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140530 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140529    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-bound-sa-token\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140537    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6c42279-c7d8-4653-90d2-895f6312deb4-registry-tls\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.140782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.140547    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6c42279-c7d8-4653-90d2-895f6312deb4-image-registry-private-configuration\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:49.218866 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.218838    2565 generic.go:358] "Generic (PLEG): container finished" podID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerID="dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919" exitCode=0
May 27 20:13:49.219019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.218898    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq"
May 27 20:13:49.219019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.218925    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" event={"ID":"d6c42279-c7d8-4653-90d2-895f6312deb4","Type":"ContainerDied","Data":"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"}
May 27 20:13:49.219019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.218966    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55964b8cfd-8n2lq" event={"ID":"d6c42279-c7d8-4653-90d2-895f6312deb4","Type":"ContainerDied","Data":"2f4f8426898308755664e3cce882518b6caf912fd9aa32407bdfd33e81404c82"}
May 27 20:13:49.219019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.218982    2565 scope.go:117] "RemoveContainer" containerID="dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"
May 27 20:13:49.227270 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.227254    2565 scope.go:117] "RemoveContainer" containerID="dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"
May 27 20:13:49.227530 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:13:49.227512    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919\": container with ID starting with dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919 not found: ID does not exist" containerID="dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"
May 27 20:13:49.227584 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.227540    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919"} err="failed to get container status \"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919\": rpc error: code = NotFound desc = could not find container \"dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919\": container with ID starting with dd63c7de35dfd071a709706290a444b261e83a7de59aa0fbd9c429fd2c226919 not found: ID does not exist"
May 27 20:13:49.240312 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.240289    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:13:49.244748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.244727    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55964b8cfd-8n2lq"]
May 27 20:13:49.629436 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:49.629404    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" path="/var/lib/kubelet/pods/d6c42279-c7d8-4653-90d2-895f6312deb4/volumes"
May 27 20:13:55.869900 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:55.869862    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-66b56c4bfd-w9mms" podUID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" containerName="console" containerID="cri-o://c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578" gracePeriod=15
May 27 20:13:56.132611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.132589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b56c4bfd-w9mms_2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff/console/0.log"
May 27 20:13:56.132711 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.132651    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:56.241020 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.240992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66b56c4bfd-w9mms_2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff/console/0.log"
May 27 20:13:56.241179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.241033    2565 generic.go:358] "Generic (PLEG): container finished" podID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" containerID="c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578" exitCode=2
May 27 20:13:56.241179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.241073    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56c4bfd-w9mms" event={"ID":"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff","Type":"ContainerDied","Data":"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"}
May 27 20:13:56.241179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.241100    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b56c4bfd-w9mms"
May 27 20:13:56.241179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.241109    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b56c4bfd-w9mms" event={"ID":"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff","Type":"ContainerDied","Data":"3101520ab1d2a31930d3b376ab0edbc803302972f16a07eb004cadc8d197b2ca"}
May 27 20:13:56.241179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.241126    2565 scope.go:117] "RemoveContainer" containerID="c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"
May 27 20:13:56.248493 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.248474    2565 scope.go:117] "RemoveContainer" containerID="c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"
May 27 20:13:56.248740 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:13:56.248722    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578\": container with ID starting with c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578 not found: ID does not exist" containerID="c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"
May 27 20:13:56.248803 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.248754    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578"} err="failed to get container status \"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578\": rpc error: code = NotFound desc = could not find container \"c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578\": container with ID starting with c7411493e8595968aa55b1051621b04582bb3a4389eb58f02977f62fb93e4578 not found: ID does not exist"
May 27 20:13:56.299967 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.299935    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp8xf\" (UniqueName: \"kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300067 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.299996    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300067 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300047    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300161 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300095    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300161 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300145    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300257 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300233    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert\") pod \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\" (UID: \"2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff\") "
May 27 20:13:56.300531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300429    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:13:56.300531 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300520    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config" (OuterVolumeSpecName: "console-config") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:13:56.300844 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.300621    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:13:56.302340 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.302319    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:13:56.302437 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.302376    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:13:56.302566 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.302546    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf" (OuterVolumeSpecName: "kube-api-access-qp8xf") pod "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" (UID: "2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff"). InnerVolumeSpecName "kube-api-access-qp8xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:13:56.401658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401585    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp8xf\" (UniqueName: \"kubernetes.io/projected/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-kube-api-access-qp8xf\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.401658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401614    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-service-ca\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.401658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401629    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.401658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401641    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.401658 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401653    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-console-oauth-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.401881 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.401667    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff-oauth-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:13:56.562289 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.562262    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:56.566393 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:56.566373    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66b56c4bfd-w9mms"]
May 27 20:13:57.633364 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:57.633324    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" path="/var/lib/kubelet/pods/2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff/volumes"
May 27 20:13:58.563590 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:58.563561    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:13:58.567207 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:13:58.567182    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6795f97778-l7lgt"
May 27 20:14:19.476586 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:19.476537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:14:19.478983 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:19.478958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2ca65ad-7d95-411a-b130-837842fb0836-metrics-certs\") pod \"network-metrics-daemon-89b9c\" (UID: \"e2ca65ad-7d95-411a-b130-837842fb0836\") " pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:14:19.529527 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:19.529493    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpcfj\""
May 27 20:14:19.537684 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:19.537664    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-89b9c"
May 27 20:14:19.663859 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:19.663826    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-89b9c"]
May 27 20:14:19.666768 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:14:19.666719    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ca65ad_7d95_411a_b130_837842fb0836.slice/crio-151015aa1cff158bfc96e515bfd41b94ab8bec8ef342bf045d2e89554a67ea5d WatchSource:0}: Error finding container 151015aa1cff158bfc96e515bfd41b94ab8bec8ef342bf045d2e89554a67ea5d: Status 404 returned error can't find the container with id 151015aa1cff158bfc96e515bfd41b94ab8bec8ef342bf045d2e89554a67ea5d
May 27 20:14:20.307488 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:20.307446    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89b9c" event={"ID":"e2ca65ad-7d95-411a-b130-837842fb0836","Type":"ContainerStarted","Data":"151015aa1cff158bfc96e515bfd41b94ab8bec8ef342bf045d2e89554a67ea5d"}
May 27 20:14:21.311318 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:21.311282    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89b9c" event={"ID":"e2ca65ad-7d95-411a-b130-837842fb0836","Type":"ContainerStarted","Data":"e5ef16ead0744eeebf15c3849600d593f5ddfbc99819d8940b3b47dde19ccb8f"}
May 27 20:14:21.311318 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:21.311323    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-89b9c" event={"ID":"e2ca65ad-7d95-411a-b130-837842fb0836","Type":"ContainerStarted","Data":"1b3b1cccdb2bbaa2ca260bbe6ccda393dd1f8e9148358a214003540d372effad"}
May 27 20:14:21.329808 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:21.329760    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-89b9c" podStartSLOduration=253.00072713 podStartE2EDuration="4m14.329745621s" podCreationTimestamp="2026-05-27 20:10:07 +0000 UTC" firstStartedPulling="2026-05-27 20:14:19.668522553 +0000 UTC m=+252.659894388" lastFinishedPulling="2026-05-27 20:14:20.997541042 +0000 UTC m=+253.988912879" observedRunningTime="2026-05-27 20:14:21.327947818 +0000 UTC m=+254.319319675" watchObservedRunningTime="2026-05-27 20:14:21.329745621 +0000 UTC m=+254.321117484"
May 27 20:14:38.178379 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178327    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8577b644c9-55tjg"]
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178608    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerName="registry"
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178619    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerName="registry"
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178630    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" containerName="console"
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178635    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" containerName="console"
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178681    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6c42279-c7d8-4653-90d2-895f6312deb4" containerName="registry"
May 27 20:14:38.178800 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.178689    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="2103c06a-8cf4-4eb7-9e4f-1220fedcd5ff" containerName="console"
May 27 20:14:38.183109 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.183079    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.186264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.186240    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 27 20:14:38.187123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.187101    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 27 20:14:38.187230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.187125    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vfzdx\""
May 27 20:14:38.187230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.187156    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 27 20:14:38.187409 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.187393    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 27 20:14:38.187466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.187437    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 27 20:14:38.196335 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.196317    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 27 20:14:38.199396 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.199373    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8577b644c9-55tjg"]
May 27 20:14:38.321041 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321176 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321176 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321176 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-metrics-client-ca\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321303 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2sx\" (UniqueName: \"kubernetes.io/projected/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-kube-api-access-kl2sx\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321303 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-serving-certs-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321303 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.321303 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.321271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-federate-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422436 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422412    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-federate-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422467    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422494    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422536    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422573    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-metrics-client-ca\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422775 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422597    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2sx\" (UniqueName: \"kubernetes.io/projected/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-kube-api-access-kl2sx\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422775 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422625    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-serving-certs-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.422775 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.422703    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.423248 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.423221    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-serving-certs-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.423539 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.423516    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-metrics-client-ca\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.423738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.423712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.425139 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.425116    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-federate-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.425500 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.425482    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-telemeter-client-tls\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.425607 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.425574    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.425697 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.425679    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-secret-telemeter-client\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.431516 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.431475    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2sx\" (UniqueName: \"kubernetes.io/projected/9209fc6b-5d3b-49fe-97e0-f8df511cfadb-kube-api-access-kl2sx\") pod \"telemeter-client-8577b644c9-55tjg\" (UID: \"9209fc6b-5d3b-49fe-97e0-f8df511cfadb\") " pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.493059 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.493040    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg"
May 27 20:14:38.621553 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:38.621521    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8577b644c9-55tjg"]
May 27 20:14:38.624664 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:14:38.624630    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9209fc6b_5d3b_49fe_97e0_f8df511cfadb.slice/crio-141e26a0e1d1b77ef4d3efaa045dc5193079b687629d47e305df796f2e6dd6cc WatchSource:0}: Error finding container 141e26a0e1d1b77ef4d3efaa045dc5193079b687629d47e305df796f2e6dd6cc: Status 404 returned error can't find the container with id 141e26a0e1d1b77ef4d3efaa045dc5193079b687629d47e305df796f2e6dd6cc
May 27 20:14:39.364618 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:39.364581    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg" event={"ID":"9209fc6b-5d3b-49fe-97e0-f8df511cfadb","Type":"ContainerStarted","Data":"141e26a0e1d1b77ef4d3efaa045dc5193079b687629d47e305df796f2e6dd6cc"}
May 27 20:14:41.371840 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:41.371808    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg" event={"ID":"9209fc6b-5d3b-49fe-97e0-f8df511cfadb","Type":"ContainerStarted","Data":"860e21de18d00536f2ffa8baa902cf6e84f5aa22c49be4576ac2fa5c6d60fddf"}
May 27 20:14:41.371840 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:41.371844    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg" event={"ID":"9209fc6b-5d3b-49fe-97e0-f8df511cfadb","Type":"ContainerStarted","Data":"326eee7978e2fa7cdb1fea4f57647a1a5edf8b9357590a9482e9d2f9f9d33ceb"}
May 27 20:14:41.372185 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:41.371853    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg" event={"ID":"9209fc6b-5d3b-49fe-97e0-f8df511cfadb","Type":"ContainerStarted","Data":"e6d0a1dab3bbbcfa074387a213521714a10d0381b88a3f1c5e289ebdef916e22"}
May 27 20:14:41.394469 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:41.394421    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8577b644c9-55tjg" podStartSLOduration=1.474583139 podStartE2EDuration="3.3944075s" podCreationTimestamp="2026-05-27 20:14:38 +0000 UTC" firstStartedPulling="2026-05-27 20:14:38.626641969 +0000 UTC m=+271.618013803" lastFinishedPulling="2026-05-27 20:14:40.546466327 +0000 UTC m=+273.537838164" observedRunningTime="2026-05-27 20:14:41.393854775 +0000 UTC m=+274.385226630" watchObservedRunningTime="2026-05-27 20:14:41.3944075 +0000 UTC m=+274.385779356"
May 27 20:14:42.160639 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.160605    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:14:42.168220 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.168195    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.170780 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.170755    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 27 20:14:42.170908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.170816    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 27 20:14:42.172931 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.172907    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 27 20:14:42.173129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.173111    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 27 20:14:42.173398 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.173379    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 27 20:14:42.173870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.173572    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vktpf\""
May 27 20:14:42.177907 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.177877    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 27 20:14:42.178315 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.178296    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:14:42.254136 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254277 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254277 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254389 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254389 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254495 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.254495 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.254465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnjz\" (UniqueName: \"kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355459 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355431    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355578 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355465    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnjz\" (UniqueName: \"kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355578 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355482    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355578 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355511    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355578 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355578 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355562    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.355834 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.355588    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.356297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.356247    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.356434 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.356411    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.356497 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.356460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.356665 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.356645    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.358625 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.358596    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.358993 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.358970    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.362849 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.362829    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnjz\" (UniqueName: \"kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz\") pod \"console-97cff87c-6wp88\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") " pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.479738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.479666    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:42.600911 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:42.600888    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:14:42.603206 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:14:42.603175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6808ae9e_3a94_42e9_9587_38bce2085c2f.slice/crio-a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8 WatchSource:0}: Error finding container a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8: Status 404 returned error can't find the container with id a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8
May 27 20:14:43.378772 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:43.378737    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cff87c-6wp88" event={"ID":"6808ae9e-3a94-42e9-9587-38bce2085c2f","Type":"ContainerStarted","Data":"287c6c66a9a56cc4b2ceee2786d615867b876a2b90e4da2ce379902b9488207b"}
May 27 20:14:43.378772 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:43.378774    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cff87c-6wp88" event={"ID":"6808ae9e-3a94-42e9-9587-38bce2085c2f","Type":"ContainerStarted","Data":"a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8"}
May 27 20:14:43.395626 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:43.395584    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-97cff87c-6wp88" podStartSLOduration=1.395571437 podStartE2EDuration="1.395571437s" podCreationTimestamp="2026-05-27 20:14:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:14:43.394478485 +0000 UTC m=+276.385850341" watchObservedRunningTime="2026-05-27 20:14:43.395571437 +0000 UTC m=+276.386943292"
May 27 20:14:52.225398 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.225364    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:14:52.253866 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.253844    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:14:52.257116 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.257102    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.265232 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.265211    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:14:52.424933 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.424904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425052 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.424948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425052 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.424970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425052 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.425029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.425085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.425109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hbvp\" (UniqueName: \"kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.425206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.425131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.480231 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.480183    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97cff87c-6wp88"
May 27 20:14:52.525990 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.525971    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526072 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526000    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526072 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526017    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526162    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526205    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hbvp\" (UniqueName: \"kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526390 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526338    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526496 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526450    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526646 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526619    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526848 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526829    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.526982 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.527024 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.526961    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.528912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.528897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.529099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.529077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.533697 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.533679    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hbvp\" (UniqueName: \"kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp\") pod \"console-f64d7776d-vnqrb\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") " pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.566695 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.566670    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:14:52.702965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:52.702942    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:14:52.705471 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:14:52.705448    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e1d419_ff4f_47dd_ba52_272709c4b143.slice/crio-e59a22800fce2588a4d7336c967be58abeef95fb8f5aaa98677b793ef817c322 WatchSource:0}: Error finding container e59a22800fce2588a4d7336c967be58abeef95fb8f5aaa98677b793ef817c322: Status 404 returned error can't find the container with id e59a22800fce2588a4d7336c967be58abeef95fb8f5aaa98677b793ef817c322
May 27 20:14:53.403950 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:53.403920    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f64d7776d-vnqrb" event={"ID":"76e1d419-ff4f-47dd-ba52-272709c4b143","Type":"ContainerStarted","Data":"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"}
May 27 20:14:53.403950 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:53.403953    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f64d7776d-vnqrb" event={"ID":"76e1d419-ff4f-47dd-ba52-272709c4b143","Type":"ContainerStarted","Data":"e59a22800fce2588a4d7336c967be58abeef95fb8f5aaa98677b793ef817c322"}
May 27 20:14:53.420543 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:14:53.420497    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f64d7776d-vnqrb" podStartSLOduration=1.420481706 podStartE2EDuration="1.420481706s" podCreationTimestamp="2026-05-27 20:14:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:14:53.419516169 +0000 UTC m=+286.410888023" watchObservedRunningTime="2026-05-27 20:14:53.420481706 +0000 UTC m=+286.411853564"
May 27 20:15:02.567153 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:02.567114    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:15:02.567153 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:02.567158    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:15:02.571611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:02.571593    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:15:03.434682 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:03.434658    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:15:07.534049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:07.534023    2565 kubelet.go:1628] "Image garbage collection succeeded"
May 27 20:15:17.243426 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.243368    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-97cff87c-6wp88" podUID="6808ae9e-3a94-42e9-9587-38bce2085c2f" containerName="console" containerID="cri-o://287c6c66a9a56cc4b2ceee2786d615867b876a2b90e4da2ce379902b9488207b" gracePeriod=15
May 27 20:15:17.470334 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.470312    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97cff87c-6wp88_6808ae9e-3a94-42e9-9587-38bce2085c2f/console/0.log"
May 27 20:15:17.470462 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.470375    2565 generic.go:358] "Generic (PLEG): container finished" podID="6808ae9e-3a94-42e9-9587-38bce2085c2f" containerID="287c6c66a9a56cc4b2ceee2786d615867b876a2b90e4da2ce379902b9488207b" exitCode=2
May 27 20:15:17.470462 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.470443    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cff87c-6wp88" event={"ID":"6808ae9e-3a94-42e9-9587-38bce2085c2f","Type":"ContainerDied","Data":"287c6c66a9a56cc4b2ceee2786d615867b876a2b90e4da2ce379902b9488207b"}
May 27 20:15:17.470539 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.470480    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97cff87c-6wp88" event={"ID":"6808ae9e-3a94-42e9-9587-38bce2085c2f","Type":"ContainerDied","Data":"a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8"}
May 27 20:15:17.470539 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.470489    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a12fa8b5fee7d2e399926020c1b44b6b4449942b44adfc54d9be58596723ecf8"
May 27 20:15:17.478439 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.478424    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97cff87c-6wp88_6808ae9e-3a94-42e9-9587-38bce2085c2f/console/0.log"
May 27 20:15:17.478501 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.478476    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cff87c-6wp88"
May 27 20:15:17.599193 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599171    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599303 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599285    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rnjz\" (UniqueName: \"kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599364 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599320    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599403 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599342    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599456 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599400    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599456 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599437    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599456 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599440    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config" (OuterVolumeSpecName: "console-config") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:15:17.599596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599465    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle\") pod \"6808ae9e-3a94-42e9-9587-38bce2085c2f\" (UID: \"6808ae9e-3a94-42e9-9587-38bce2085c2f\") "
May 27 20:15:17.599742 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599713    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.599846 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599784    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca" (OuterVolumeSpecName: "service-ca") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:15:17.599846 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599827    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:15:17.599967 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.599858    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:15:17.601596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.601568    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:15:17.601870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.601845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:15:17.601942 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.601871    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz" (OuterVolumeSpecName: "kube-api-access-7rnjz") pod "6808ae9e-3a94-42e9-9587-38bce2085c2f" (UID: "6808ae9e-3a94-42e9-9587-38bce2085c2f"). InnerVolumeSpecName "kube-api-access-7rnjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:15:17.700887 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700862    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rnjz\" (UniqueName: \"kubernetes.io/projected/6808ae9e-3a94-42e9-9587-38bce2085c2f-kube-api-access-7rnjz\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.700965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700889    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-service-ca\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.700965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700902    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-oauth-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.700965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700913    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-oauth-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.700965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700922    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6808ae9e-3a94-42e9-9587-38bce2085c2f-console-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:17.700965 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:17.700930    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6808ae9e-3a94-42e9-9587-38bce2085c2f-trusted-ca-bundle\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:15:18.472618 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:18.472594    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97cff87c-6wp88"
May 27 20:15:18.492616 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:18.492596    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:15:18.497575 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:18.497555    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97cff87c-6wp88"]
May 27 20:15:19.629361 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:19.629315    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6808ae9e-3a94-42e9-9587-38bce2085c2f" path="/var/lib/kubelet/pods/6808ae9e-3a94-42e9-9587-38bce2085c2f/volumes"
May 27 20:15:49.176141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.176110    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"]
May 27 20:15:49.176611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.176400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6808ae9e-3a94-42e9-9587-38bce2085c2f" containerName="console"
May 27 20:15:49.176611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.176412    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6808ae9e-3a94-42e9-9587-38bce2085c2f" containerName="console"
May 27 20:15:49.176611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.176469    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="6808ae9e-3a94-42e9-9587-38bce2085c2f" containerName="console"
May 27 20:15:49.179173 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.179158    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.182145 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.182123    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 20:15:49.183277 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.183260    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 20:15:49.183393 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.183295    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 20:15:49.183817 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.183798    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mn8bw\""
May 27 20:15:49.183924 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.183838    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 20:15:49.189663 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.189638    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"]
May 27 20:15:49.200803 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.200781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh558\" (UniqueName: \"kubernetes.io/projected/3fca1dcb-09c8-4f74-8216-a3918e801e10-kube-api-access-jh558\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.200903 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.200828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fca1dcb-09c8-4f74-8216-a3918e801e10-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.302062 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.302037    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fca1dcb-09c8-4f74-8216-a3918e801e10-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.302148 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.302090    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh558\" (UniqueName: \"kubernetes.io/projected/3fca1dcb-09c8-4f74-8216-a3918e801e10-kube-api-access-jh558\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.304586 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.304568    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3fca1dcb-09c8-4f74-8216-a3918e801e10-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.314479 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.314460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh558\" (UniqueName: \"kubernetes.io/projected/3fca1dcb-09c8-4f74-8216-a3918e801e10-kube-api-access-jh558\") pod \"managed-serviceaccount-addon-agent-599446c6d4-4qpkv\" (UID: \"3fca1dcb-09c8-4f74-8216-a3918e801e10\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.433315 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.433262    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"]
May 27 20:15:49.436647 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.436633    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.439454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.439433    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 27 20:15:49.439454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.439446    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 27 20:15:49.439577 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.439433    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 27 20:15:49.439577 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.439446    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 27 20:15:49.448973 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.448953    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"]
May 27 20:15:49.497587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.497559    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"
May 27 20:15:49.503541 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.503629 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.503629 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.503738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khbr7\" (UniqueName: \"kubernetes.io/projected/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-kube-api-access-khbr7\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.503738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.503738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.503703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.604751 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604720    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.604893 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604781    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.604893 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604806    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.604893 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604846    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khbr7\" (UniqueName: \"kubernetes.io/projected/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-kube-api-access-khbr7\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.604893 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604890    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.605091 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.604936    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.605542 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.605520    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.607834 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.607811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.607917 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.607836    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.607960 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.607922    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-ca\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.607994 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.607962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.614248 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.614230    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khbr7\" (UniqueName: \"kubernetes.io/projected/fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8-kube-api-access-khbr7\") pod \"cluster-proxy-proxy-agent-c64785cdf-ff4rq\" (UID: \"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.619324 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.619304    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv"]
May 27 20:15:49.621688 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:15:49.621662    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fca1dcb_09c8_4f74_8216_a3918e801e10.slice/crio-df86525dfa78e926c8944debf026141bd9d1c5977f5b783ca300066732013673 WatchSource:0}: Error finding container df86525dfa78e926c8944debf026141bd9d1c5977f5b783ca300066732013673: Status 404 returned error can't find the container with id df86525dfa78e926c8944debf026141bd9d1c5977f5b783ca300066732013673
May 27 20:15:49.623375 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.623362    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 20:15:49.745075 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.745022    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"
May 27 20:15:49.863588 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:49.863506    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq"]
May 27 20:15:49.865630 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:15:49.865605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbaeef27_cf9e_4abc_b21d_0c3c5f8ee7b8.slice/crio-36c7c906a54087ead9a54cc185f8a0935b7737c02589b3a35e6506b8a288dd7e WatchSource:0}: Error finding container 36c7c906a54087ead9a54cc185f8a0935b7737c02589b3a35e6506b8a288dd7e: Status 404 returned error can't find the container with id 36c7c906a54087ead9a54cc185f8a0935b7737c02589b3a35e6506b8a288dd7e
May 27 20:15:50.558399 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:50.558341    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq" event={"ID":"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8","Type":"ContainerStarted","Data":"36c7c906a54087ead9a54cc185f8a0935b7737c02589b3a35e6506b8a288dd7e"}
May 27 20:15:50.559739 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:50.559707    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv" event={"ID":"3fca1dcb-09c8-4f74-8216-a3918e801e10","Type":"ContainerStarted","Data":"df86525dfa78e926c8944debf026141bd9d1c5977f5b783ca300066732013673"}
May 27 20:15:52.566844 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:52.566809    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv" event={"ID":"3fca1dcb-09c8-4f74-8216-a3918e801e10","Type":"ContainerStarted","Data":"98c843623c712a05229301d261ddd979ef80881d2800969ba7a11e6f2f64b8b8"}
May 27 20:15:52.583357 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:52.583308    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-599446c6d4-4qpkv" podStartSLOduration=1.2558942659999999 podStartE2EDuration="3.583295448s" podCreationTimestamp="2026-05-27 20:15:49 +0000 UTC" firstStartedPulling="2026-05-27 20:15:49.623480511 +0000 UTC m=+342.614852348" lastFinishedPulling="2026-05-27 20:15:51.950881693 +0000 UTC m=+344.942253530" observedRunningTime="2026-05-27 20:15:52.581405859 +0000 UTC m=+345.572777716" watchObservedRunningTime="2026-05-27 20:15:52.583295448 +0000 UTC m=+345.574667303"
May 27 20:15:56.581086 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:56.581055    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq" event={"ID":"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8","Type":"ContainerStarted","Data":"987f402f274521caeafe4e2fac1ccadf422019ef565dfd2c3c43bf34f711f5df"}
May 27 20:15:59.590636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:59.590606    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq" event={"ID":"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8","Type":"ContainerStarted","Data":"a0542e819dcca7fb0b55b9faf923d1de8934bd41c4185b78d7bfddb976455162"}
May 27 20:15:59.590636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:59.590641    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq" event={"ID":"fbaeef27-cf9e-4abc-b21d-0c3c5f8ee7b8","Type":"ContainerStarted","Data":"b31a762e6fca1b6ff2488c9b09f4a16a9f8deebd93b0c70c82c3d8937b1d6985"}
May 27 20:15:59.609447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:15:59.609383    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c64785cdf-ff4rq" podStartSLOduration=1.67298918 podStartE2EDuration="10.609368308s" podCreationTimestamp="2026-05-27 20:15:49 +0000 UTC" firstStartedPulling="2026-05-27 20:15:49.867283613 +0000 UTC m=+342.858655455" lastFinishedPulling="2026-05-27 20:15:58.803662748 +0000 UTC m=+351.795034583" observedRunningTime="2026-05-27 20:15:59.607197861 +0000 UTC m=+352.598569716" watchObservedRunningTime="2026-05-27 20:15:59.609368308 +0000 UTC m=+352.600740171"
May 27 20:17:15.085712 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.085683    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"]
May 27 20:17:15.088931 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.088914    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.092670 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092643    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 27 20:17:15.092670 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092668    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 27 20:17:15.092845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092644    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-przvn\""
May 27 20:17:15.092845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092699    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 27 20:17:15.092845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092703    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 27 20:17:15.092845 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.092669    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 27 20:17:15.096995 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.096978    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"]
May 27 20:17:15.197555 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.197530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hfs\" (UniqueName: \"kubernetes.io/projected/36cd6214-eb6e-4cee-b6ed-57e68a920167-kube-api-access-l7hfs\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.197676 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.197578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36cd6214-eb6e-4cee-b6ed-57e68a920167-manager-config\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.197676 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.197667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-metrics-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.197760 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.197698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.298870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.298851    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-metrics-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.298967 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.298883    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.299041 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.299021    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hfs\" (UniqueName: \"kubernetes.io/projected/36cd6214-eb6e-4cee-b6ed-57e68a920167-kube-api-access-l7hfs\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.299099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.299076    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36cd6214-eb6e-4cee-b6ed-57e68a920167-manager-config\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.299649 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.299618    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36cd6214-eb6e-4cee-b6ed-57e68a920167-manager-config\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.301254 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.301229    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.301330 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.301299    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36cd6214-eb6e-4cee-b6ed-57e68a920167-metrics-cert\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.318262 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.318235    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hfs\" (UniqueName: \"kubernetes.io/projected/36cd6214-eb6e-4cee-b6ed-57e68a920167-kube-api-access-l7hfs\") pod \"lws-controller-manager-5b4cbbc776-nsp68\" (UID: \"36cd6214-eb6e-4cee-b6ed-57e68a920167\") " pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.398912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.398865    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:15.524419 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.524398    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"]
May 27 20:17:15.526872 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:17:15.526846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36cd6214_eb6e_4cee_b6ed_57e68a920167.slice/crio-ddcb2f04ca2de3a08200263dc0417959f19f3ca4e35f31bff87bd67ce00de514 WatchSource:0}: Error finding container ddcb2f04ca2de3a08200263dc0417959f19f3ca4e35f31bff87bd67ce00de514: Status 404 returned error can't find the container with id ddcb2f04ca2de3a08200263dc0417959f19f3ca4e35f31bff87bd67ce00de514
May 27 20:17:15.782549 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:15.782517    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68" event={"ID":"36cd6214-eb6e-4cee-b6ed-57e68a920167","Type":"ContainerStarted","Data":"ddcb2f04ca2de3a08200263dc0417959f19f3ca4e35f31bff87bd67ce00de514"}
May 27 20:17:20.797476 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:20.797444    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68" event={"ID":"36cd6214-eb6e-4cee-b6ed-57e68a920167","Type":"ContainerStarted","Data":"b57ed4d7d64ac46f554f5412dd570e526e79457f788bb50701e54ada3b87fab2"}
May 27 20:17:20.797889 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:20.797572    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:20.827882 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:20.827842    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68" podStartSLOduration=1.5532298469999999 podStartE2EDuration="5.827832256s" podCreationTimestamp="2026-05-27 20:17:15 +0000 UTC" firstStartedPulling="2026-05-27 20:17:15.528484056 +0000 UTC m=+428.519855890" lastFinishedPulling="2026-05-27 20:17:19.803086463 +0000 UTC m=+432.794458299" observedRunningTime="2026-05-27 20:17:20.826626221 +0000 UTC m=+433.817998077" watchObservedRunningTime="2026-05-27 20:17:20.827832256 +0000 UTC m=+433.819204110"
May 27 20:17:22.190948 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.190918    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"]
May 27 20:17:22.194498 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.194477    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.197497 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.197473    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 20:17:22.197884 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.197867    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 20:17:22.198042 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.198024    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 20:17:22.198158 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.198140    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d4zz8\""
May 27 20:17:22.198206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.198174    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 20:17:22.209563 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.209543    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"]
May 27 20:17:22.351239 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.351218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.351321 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.351248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.351321 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.351283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g586\" (UniqueName: \"kubernetes.io/projected/864e264c-b3c8-49f7-aa7f-1130f95134a1-kube-api-access-2g586\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.452120 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.452073    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2g586\" (UniqueName: \"kubernetes.io/projected/864e264c-b3c8-49f7-aa7f-1130f95134a1-kube-api-access-2g586\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.452120 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.452118    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.452223 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.452140    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.454463 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.454443    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.454539 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.454488    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/864e264c-b3c8-49f7-aa7f-1130f95134a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.459529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.459509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g586\" (UniqueName: \"kubernetes.io/projected/864e264c-b3c8-49f7-aa7f-1130f95134a1-kube-api-access-2g586\") pod \"opendatahub-operator-controller-manager-59479dd8d-srv8p\" (UID: \"864e264c-b3c8-49f7-aa7f-1130f95134a1\") " pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.504046 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.504027    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:22.627483 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.627459    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"]
May 27 20:17:22.629834 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:17:22.629809    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864e264c_b3c8_49f7_aa7f_1130f95134a1.slice/crio-32710b302318928fba584117f0506c8390565a7240097130ca41d6169346a030 WatchSource:0}: Error finding container 32710b302318928fba584117f0506c8390565a7240097130ca41d6169346a030: Status 404 returned error can't find the container with id 32710b302318928fba584117f0506c8390565a7240097130ca41d6169346a030
May 27 20:17:22.807261 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:22.807229    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p" event={"ID":"864e264c-b3c8-49f7-aa7f-1130f95134a1","Type":"ContainerStarted","Data":"32710b302318928fba584117f0506c8390565a7240097130ca41d6169346a030"}
May 27 20:17:25.818391 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:25.818329    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p" event={"ID":"864e264c-b3c8-49f7-aa7f-1130f95134a1","Type":"ContainerStarted","Data":"fd171fc6924fa88140f41c93c63045ecc769228ad3057b29c7ea80d4bafc17d1"}
May 27 20:17:25.818782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:25.818498    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:17:25.842795 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:25.842728    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p" podStartSLOduration=1.4231013510000001 podStartE2EDuration="3.842716249s" podCreationTimestamp="2026-05-27 20:17:22 +0000 UTC" firstStartedPulling="2026-05-27 20:17:22.631521612 +0000 UTC m=+435.622893446" lastFinishedPulling="2026-05-27 20:17:25.051136506 +0000 UTC m=+438.042508344" observedRunningTime="2026-05-27 20:17:25.841107274 +0000 UTC m=+438.832479128" watchObservedRunningTime="2026-05-27 20:17:25.842716249 +0000 UTC m=+438.834088104"
May 27 20:17:31.801308 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:31.801239    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b4cbbc776-nsp68"
May 27 20:17:36.823159 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:17:36.823133    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59479dd8d-srv8p"
May 27 20:18:13.704619 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.704589    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"]
May 27 20:18:13.707626 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.707611    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.710424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.710337    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sjf9z\""
May 27 20:18:13.710534 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.710441    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 27 20:18:13.710534 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.710392    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 20:18:13.710534 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.710466    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 20:18:13.718560 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.718537    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"]
May 27 20:18:13.795619 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795703 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795798 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795798 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795798 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795798 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.795909 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.795866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnts\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-kube-api-access-qvnts\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897133 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897111    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnts\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-kube-api-access-qvnts\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897221 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897138    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897221 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897160    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897221 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897179    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897221 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897196    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897221 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897218    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897499 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897406    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897499 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897441    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897499 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897471    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897663 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897663 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897620    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897663 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897651    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897809 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897710    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.897927 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.897911    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.899626 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.899602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.899727 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.899713    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.914088 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.914068    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnts\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-kube-api-access-qvnts\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:13.916234 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:13.916215    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188d4c89-ac5c-4bb2-ab40-8d0a02f74a05-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g\" (UID: \"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:14.017023 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:14.016999    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:14.146331 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:14.146307    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"]
May 27 20:18:14.146985 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:18:14.146961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188d4c89_ac5c_4bb2_ab40_8d0a02f74a05.slice/crio-363e4322d911d808b039b9aa0835154a5328bc4d063cec098ffbdce6dbeba132 WatchSource:0}: Error finding container 363e4322d911d808b039b9aa0835154a5328bc4d063cec098ffbdce6dbeba132: Status 404 returned error can't find the container with id 363e4322d911d808b039b9aa0835154a5328bc4d063cec098ffbdce6dbeba132
May 27 20:18:14.972612 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:14.972583    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g" event={"ID":"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05","Type":"ContainerStarted","Data":"363e4322d911d808b039b9aa0835154a5328bc4d063cec098ffbdce6dbeba132"}
May 27 20:18:16.621527 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:16.621491    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:18:16.621803 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:16.621560    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:18:16.621803 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:16.621591    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:18:16.981593 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:16.981487    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g" event={"ID":"188d4c89-ac5c-4bb2-ab40-8d0a02f74a05","Type":"ContainerStarted","Data":"ff849a52e5f706c2a417f48379bedc0f1652ea5b2243d03a9370bbf7a6446eac"}
May 27 20:18:17.012613 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:17.012564    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g" podStartSLOduration=1.539976923 podStartE2EDuration="4.012549874s" podCreationTimestamp="2026-05-27 20:18:13 +0000 UTC" firstStartedPulling="2026-05-27 20:18:14.148688447 +0000 UTC m=+487.140060281" lastFinishedPulling="2026-05-27 20:18:16.621261395 +0000 UTC m=+489.612633232" observedRunningTime="2026-05-27 20:18:17.009638379 +0000 UTC m=+490.001010235" watchObservedRunningTime="2026-05-27 20:18:17.012549874 +0000 UTC m=+490.003921728"
May 27 20:18:17.017669 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:17.017649    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:17.021476 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:17.021451    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:17.983910 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:17.983882    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:17.984594 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:17.984577    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g"
May 27 20:18:39.780818 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.780786    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:39.784042 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.784028    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:39.786635 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.786617    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 20:18:39.787621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.787602    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-g67zc\""
May 27 20:18:39.787621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.787617    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 20:18:39.791640 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.791612    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:39.873953 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.873928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc7n7\" (UniqueName: \"kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7\") pod \"kuadrant-operator-catalog-tzj9h\" (UID: \"b28d2fd3-3be1-4a2f-b349-8f138e772d60\") " pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:39.974451 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.974425    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wc7n7\" (UniqueName: \"kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7\") pod \"kuadrant-operator-catalog-tzj9h\" (UID: \"b28d2fd3-3be1-4a2f-b349-8f138e772d60\") " pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:39.994064 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:39.994044    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc7n7\" (UniqueName: \"kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7\") pod \"kuadrant-operator-catalog-tzj9h\" (UID: \"b28d2fd3-3be1-4a2f-b349-8f138e772d60\") " pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:40.093617 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.093560    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:40.145533 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.145479    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:40.215043 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.215019    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:40.216997 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:18:40.216973    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28d2fd3_3be1_4a2f_b349_8f138e772d60.slice/crio-73de2a09abcb6f5371a424e1a6182e6c3a7a516ecda4a573820a38e3a1bdb826 WatchSource:0}: Error finding container 73de2a09abcb6f5371a424e1a6182e6c3a7a516ecda4a573820a38e3a1bdb826: Status 404 returned error can't find the container with id 73de2a09abcb6f5371a424e1a6182e6c3a7a516ecda4a573820a38e3a1bdb826
May 27 20:18:40.354286 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.354235    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mbd"]
May 27 20:18:40.358729 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.358715    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:40.363908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.363886    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mbd"]
May 27 20:18:40.479586 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.479560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkscp\" (UniqueName: \"kubernetes.io/projected/902f6264-bcd2-4aff-a3d2-8514a0348b84-kube-api-access-zkscp\") pod \"kuadrant-operator-catalog-n8mbd\" (UID: \"902f6264-bcd2-4aff-a3d2-8514a0348b84\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:40.580121 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.580099    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkscp\" (UniqueName: \"kubernetes.io/projected/902f6264-bcd2-4aff-a3d2-8514a0348b84-kube-api-access-zkscp\") pod \"kuadrant-operator-catalog-n8mbd\" (UID: \"902f6264-bcd2-4aff-a3d2-8514a0348b84\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:40.588076 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.588057    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkscp\" (UniqueName: \"kubernetes.io/projected/902f6264-bcd2-4aff-a3d2-8514a0348b84-kube-api-access-zkscp\") pod \"kuadrant-operator-catalog-n8mbd\" (UID: \"902f6264-bcd2-4aff-a3d2-8514a0348b84\") " pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:40.668575 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.668527    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:40.795833 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:40.795812    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n8mbd"]
May 27 20:18:40.842094 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:18:40.842056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902f6264_bcd2_4aff_a3d2_8514a0348b84.slice/crio-1432f88d0f018bdb18e0ecdc20488f7699ebb92c83e7c63fd79ddf57296bde7e WatchSource:0}: Error finding container 1432f88d0f018bdb18e0ecdc20488f7699ebb92c83e7c63fd79ddf57296bde7e: Status 404 returned error can't find the container with id 1432f88d0f018bdb18e0ecdc20488f7699ebb92c83e7c63fd79ddf57296bde7e
May 27 20:18:41.051674 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:41.051646    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" event={"ID":"b28d2fd3-3be1-4a2f-b349-8f138e772d60","Type":"ContainerStarted","Data":"73de2a09abcb6f5371a424e1a6182e6c3a7a516ecda4a573820a38e3a1bdb826"}
May 27 20:18:41.052629 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:41.052601    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd" event={"ID":"902f6264-bcd2-4aff-a3d2-8514a0348b84","Type":"ContainerStarted","Data":"1432f88d0f018bdb18e0ecdc20488f7699ebb92c83e7c63fd79ddf57296bde7e"}
May 27 20:18:43.061105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.061068    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd" event={"ID":"902f6264-bcd2-4aff-a3d2-8514a0348b84","Type":"ContainerStarted","Data":"c9a2b2ef3f1b5de4f9b6d4cb888b6832f1050586bbdb37c8dcaf899c55f733ca"}
May 27 20:18:43.062431 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.062409    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" event={"ID":"b28d2fd3-3be1-4a2f-b349-8f138e772d60","Type":"ContainerStarted","Data":"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"}
May 27 20:18:43.062520 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.062469    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" podUID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" containerName="registry-server" containerID="cri-o://103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5" gracePeriod=2
May 27 20:18:43.079430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.079391    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd" podStartSLOduration=1.439212073 podStartE2EDuration="3.07937891s" podCreationTimestamp="2026-05-27 20:18:40 +0000 UTC" firstStartedPulling="2026-05-27 20:18:40.843392841 +0000 UTC m=+513.834764675" lastFinishedPulling="2026-05-27 20:18:42.483559669 +0000 UTC m=+515.474931512" observedRunningTime="2026-05-27 20:18:43.077640932 +0000 UTC m=+516.069012789" watchObservedRunningTime="2026-05-27 20:18:43.07937891 +0000 UTC m=+516.070750764"
May 27 20:18:43.094675 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.094636    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" podStartSLOduration=1.895483924 podStartE2EDuration="4.094622252s" podCreationTimestamp="2026-05-27 20:18:39 +0000 UTC" firstStartedPulling="2026-05-27 20:18:40.218523891 +0000 UTC m=+513.209895726" lastFinishedPulling="2026-05-27 20:18:42.417662218 +0000 UTC m=+515.409034054" observedRunningTime="2026-05-27 20:18:43.092815528 +0000 UTC m=+516.084187393" watchObservedRunningTime="2026-05-27 20:18:43.094622252 +0000 UTC m=+516.085994106"
May 27 20:18:43.297872 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.297851    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:43.405714 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.405651    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc7n7\" (UniqueName: \"kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7\") pod \"b28d2fd3-3be1-4a2f-b349-8f138e772d60\" (UID: \"b28d2fd3-3be1-4a2f-b349-8f138e772d60\") "
May 27 20:18:43.407726 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.407706    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7" (OuterVolumeSpecName: "kube-api-access-wc7n7") pod "b28d2fd3-3be1-4a2f-b349-8f138e772d60" (UID: "b28d2fd3-3be1-4a2f-b349-8f138e772d60"). InnerVolumeSpecName "kube-api-access-wc7n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:18:43.506492 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:43.506471    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc7n7\" (UniqueName: \"kubernetes.io/projected/b28d2fd3-3be1-4a2f-b349-8f138e772d60-kube-api-access-wc7n7\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:18:44.066110 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.066086    2565 generic.go:358] "Generic (PLEG): container finished" podID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" containerID="103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5" exitCode=0
May 27 20:18:44.066450 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.066137    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h"
May 27 20:18:44.066450 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.066164    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" event={"ID":"b28d2fd3-3be1-4a2f-b349-8f138e772d60","Type":"ContainerDied","Data":"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"}
May 27 20:18:44.066450 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.066197    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tzj9h" event={"ID":"b28d2fd3-3be1-4a2f-b349-8f138e772d60","Type":"ContainerDied","Data":"73de2a09abcb6f5371a424e1a6182e6c3a7a516ecda4a573820a38e3a1bdb826"}
May 27 20:18:44.066450 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.066211    2565 scope.go:117] "RemoveContainer" containerID="103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"
May 27 20:18:44.074294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.074279    2565 scope.go:117] "RemoveContainer" containerID="103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"
May 27 20:18:44.074549 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:18:44.074532    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5\": container with ID starting with 103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5 not found: ID does not exist" containerID="103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"
May 27 20:18:44.074591 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.074557    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5"} err="failed to get container status \"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5\": rpc error: code = NotFound desc = could not find container \"103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5\": container with ID starting with 103d6b3a6b66bbb67a9ee749a5faa22d05b26f7f8f474d9ed801b7dde5d67db5 not found: ID does not exist"
May 27 20:18:44.082927 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.082906    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:44.086740 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:44.086718    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tzj9h"]
May 27 20:18:45.629107 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:45.629079    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" path="/var/lib/kubelet/pods/b28d2fd3-3be1-4a2f-b349-8f138e772d60/volumes"
May 27 20:18:50.668897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:50.668868    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:50.668897 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:50.668899    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:50.689432 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:50.689410    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:18:51.107876 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:18:51.107849    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n8mbd"
May 27 20:19:07.147245 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.147170    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"]
May 27 20:19:07.147589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.147546    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" containerName="registry-server"
May 27 20:19:07.147589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.147559    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" containerName="registry-server"
May 27 20:19:07.147654 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.147625    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="b28d2fd3-3be1-4a2f-b349-8f138e772d60" containerName="registry-server"
May 27 20:19:07.150570 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.150551    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:07.154298 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.154276    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6glpd\""
May 27 20:19:07.154410 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.154315    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 20:19:07.168539 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.168519    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"]
May 27 20:19:07.277528 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.277502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxbz\" (UniqueName: \"kubernetes.io/projected/c00bbf53-4956-4fc3-8b79-de4034d58b6f-kube-api-access-jpxbz\") pod \"dns-operator-controller-manager-648d5c98bc-646xs\" (UID: \"c00bbf53-4956-4fc3-8b79-de4034d58b6f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:07.378788 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.378760    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxbz\" (UniqueName: \"kubernetes.io/projected/c00bbf53-4956-4fc3-8b79-de4034d58b6f-kube-api-access-jpxbz\") pod \"dns-operator-controller-manager-648d5c98bc-646xs\" (UID: \"c00bbf53-4956-4fc3-8b79-de4034d58b6f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:07.390852 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.390829    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxbz\" (UniqueName: \"kubernetes.io/projected/c00bbf53-4956-4fc3-8b79-de4034d58b6f-kube-api-access-jpxbz\") pod \"dns-operator-controller-manager-648d5c98bc-646xs\" (UID: \"c00bbf53-4956-4fc3-8b79-de4034d58b6f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:07.460180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.460122    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:07.591786 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:07.591765    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"]
May 27 20:19:07.594068 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:07.594033    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00bbf53_4956_4fc3_8b79_de4034d58b6f.slice/crio-e4c51c0be20d0de603d5b307c854ca1171d8292ce20775bc2127eda254d2018c WatchSource:0}: Error finding container e4c51c0be20d0de603d5b307c854ca1171d8292ce20775bc2127eda254d2018c: Status 404 returned error can't find the container with id e4c51c0be20d0de603d5b307c854ca1171d8292ce20775bc2127eda254d2018c
May 27 20:19:08.138744 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:08.138717    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs" event={"ID":"c00bbf53-4956-4fc3-8b79-de4034d58b6f","Type":"ContainerStarted","Data":"e4c51c0be20d0de603d5b307c854ca1171d8292ce20775bc2127eda254d2018c"}
May 27 20:19:09.632378 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:09.632338    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 20:19:10.147507 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:10.147475    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs" event={"ID":"c00bbf53-4956-4fc3-8b79-de4034d58b6f","Type":"ContainerStarted","Data":"6cc95f0b97e1d687c8f49a470d42187a4346b0b5829f6d25bf73bf94a55954c1"}
May 27 20:19:10.147646 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:10.147626    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:10.165306 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:10.165266    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs" podStartSLOduration=1.13110896 podStartE2EDuration="3.165251491s" podCreationTimestamp="2026-05-27 20:19:07 +0000 UTC" firstStartedPulling="2026-05-27 20:19:07.595854974 +0000 UTC m=+540.587226808" lastFinishedPulling="2026-05-27 20:19:09.6299975 +0000 UTC m=+542.621369339" observedRunningTime="2026-05-27 20:19:10.163860945 +0000 UTC m=+543.155232801" watchObservedRunningTime="2026-05-27 20:19:10.165251491 +0000 UTC m=+543.156623345"
May 27 20:19:15.644171 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.644136    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"]
May 27 20:19:15.649149 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.649128    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.653119 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.653101    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qjqg7\""
May 27 20:19:15.664393 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.664372    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"]
May 27 20:19:15.741109 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.741082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.741217 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.741123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252jm\" (UniqueName: \"kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.842456 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.842429    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.842558 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.842465    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-252jm\" (UniqueName: \"kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.842774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.842758    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.855227 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.855208    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-252jm\" (UniqueName: \"kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:15.958241 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:15.958193    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:16.083728 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:16.083694    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"]
May 27 20:19:16.086013 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:16.085985    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ddc063_806e_403f_870a_e1f7f9ca2975.slice/crio-0c41305a73e14849a4ebf93d1f111d34cf1410bccfd1e98b298f2f90388789af WatchSource:0}: Error finding container 0c41305a73e14849a4ebf93d1f111d34cf1410bccfd1e98b298f2f90388789af: Status 404 returned error can't find the container with id 0c41305a73e14849a4ebf93d1f111d34cf1410bccfd1e98b298f2f90388789af
May 27 20:19:16.171359 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:16.171314    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" event={"ID":"e5ddc063-806e-403f-870a-e1f7f9ca2975","Type":"ContainerStarted","Data":"0c41305a73e14849a4ebf93d1f111d34cf1410bccfd1e98b298f2f90388789af"}
May 27 20:19:21.153624 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:21.153539    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-646xs"
May 27 20:19:21.191203 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:21.191170    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" event={"ID":"e5ddc063-806e-403f-870a-e1f7f9ca2975","Type":"ContainerStarted","Data":"eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936"}
May 27 20:19:21.191393 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:21.191380    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:21.210912 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:21.210866    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" podStartSLOduration=2.141889184 podStartE2EDuration="6.210850228s" podCreationTimestamp="2026-05-27 20:19:15 +0000 UTC" firstStartedPulling="2026-05-27 20:19:16.088058982 +0000 UTC m=+549.079430816" lastFinishedPulling="2026-05-27 20:19:20.157020019 +0000 UTC m=+553.148391860" observedRunningTime="2026-05-27 20:19:21.210482991 +0000 UTC m=+554.201854850" watchObservedRunningTime="2026-05-27 20:19:21.210850228 +0000 UTC m=+554.202222082"
May 27 20:19:22.692808 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.692781    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"]
May 27 20:19:22.696141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.696125    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.698764 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.698730    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4gmv5\""
May 27 20:19:22.698870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.698763    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 27 20:19:22.698870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.698763    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 27 20:19:22.705760 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.705739    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"]
May 27 20:19:22.794977 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.794953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9debb8e-f200-451e-9f9b-a2010318d5af-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.795113 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.795007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.795113 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.795025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/a9debb8e-f200-451e-9f9b-a2010318d5af-kube-api-access-zvkgf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.895462 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.895437    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.895551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.895466    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/a9debb8e-f200-451e-9f9b-a2010318d5af-kube-api-access-zvkgf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.895551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.895530    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9debb8e-f200-451e-9f9b-a2010318d5af-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.895620 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:19:22.895579    2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
May 27 20:19:22.895661 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:19:22.895651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert podName:a9debb8e-f200-451e-9f9b-a2010318d5af nodeName:}" failed. No retries permitted until 2026-05-27 20:19:23.395631341 +0000 UTC m=+556.387003187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-t4z8x" (UID: "a9debb8e-f200-451e-9f9b-a2010318d5af") : secret "plugin-serving-cert" not found
May 27 20:19:22.896148 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.896127    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9debb8e-f200-451e-9f9b-a2010318d5af-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:22.908548 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:22.908524    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/a9debb8e-f200-451e-9f9b-a2010318d5af-kube-api-access-zvkgf\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:23.398204 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:23.398183    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:23.400411 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:23.400388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9debb8e-f200-451e-9f9b-a2010318d5af-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-t4z8x\" (UID: \"a9debb8e-f200-451e-9f9b-a2010318d5af\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:23.605758 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:23.605731    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"
May 27 20:19:23.732430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:23.732407    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x"]
May 27 20:19:23.734110 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:23.734084    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9debb8e_f200_451e_9f9b_a2010318d5af.slice/crio-960c851a567266f7b6a7dad728a3eda43714a91dc977fc3b613691a739b34f86 WatchSource:0}: Error finding container 960c851a567266f7b6a7dad728a3eda43714a91dc977fc3b613691a739b34f86: Status 404 returned error can't find the container with id 960c851a567266f7b6a7dad728a3eda43714a91dc977fc3b613691a739b34f86
May 27 20:19:24.208534 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:24.208503    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x" event={"ID":"a9debb8e-f200-451e-9f9b-a2010318d5af","Type":"ContainerStarted","Data":"960c851a567266f7b6a7dad728a3eda43714a91dc977fc3b613691a739b34f86"}
May 27 20:19:32.197440 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:32.197406    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:33.467635 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.467602    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"]
May 27 20:19:33.471114 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.471095    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.480699 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.480659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.480828 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.480723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4nvq\" (UniqueName: \"kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.484097 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.484057    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"]
May 27 20:19:33.582094 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.582058    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.582252 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.582120    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4nvq\" (UniqueName: \"kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.582452 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.582424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.609758 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.609730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4nvq\" (UniqueName: \"kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.651030 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.651001    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"]
May 27 20:19:33.651301 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.651283    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:33.966836 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.966801    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"]
May 27 20:19:33.967080 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.967053    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" containerName="manager" containerID="cri-o://eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936" gracePeriod=2
May 27 20:19:33.980718 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.980692    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"]
May 27 20:19:33.997264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.995511    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:33.997264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.996055    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" containerName="manager"
May 27 20:19:33.997264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.996072    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" containerName="manager"
May 27 20:19:33.997264 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:33.996173    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" containerName="manager"
May 27 20:19:34.001284 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.001261    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"]
May 27 20:19:34.001441 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.001296    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"]
May 27 20:19:34.001441 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.001414    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.007217 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.007107    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:34.039310 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.039284    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:19:34.043174 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.043153    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.060769 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.060744    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:19:34.086434 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.086405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.086551 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.086508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7wms\" (UniqueName: \"kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.086649 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.086624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.086737 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.086661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g7r7\" (UniqueName: \"kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.187146 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187114    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7wms\" (UniqueName: \"kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.187386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187172    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.187386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187196    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6g7r7\" (UniqueName: \"kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.187386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187237    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.187640 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187616    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.187640 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.187631    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.195636 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.195614    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7wms\" (UniqueName: \"kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms\") pod \"kuadrant-operator-controller-manager-84b657d985-zjbhd\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:34.196004 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.195984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g7r7\" (UniqueName: \"kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-nnmq4\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.339910 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.339871    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:34.355127 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:34.355096    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:46.892654 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:46.892592    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:19:46.893133 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:46.893080    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:46.894278 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:46.894236    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd80911_1041_4360_bc3f_c443ea774df4.slice/crio-5a7abad42f1d7889204cb95d99f7a68f36b848754f9454cd2fd98ca162f50b49 WatchSource:0}: Error finding container 5a7abad42f1d7889204cb95d99f7a68f36b848754f9454cd2fd98ca162f50b49: Status 404 returned error can't find the container with id 5a7abad42f1d7889204cb95d99f7a68f36b848754f9454cd2fd98ca162f50b49
May 27 20:19:46.895443 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:46.895397    2565 status_manager.go:895] "Failed to get status for pod" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:46.915957 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:46.915936    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:46.917754 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:46.917728    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3705ed72_a1f5_4b74_9599_9b054e9ef972.slice/crio-d85bb3ed47cd971ea5a5ca1cb83b5af60e8a58ab45e72d65ac76092eac1e1633 WatchSource:0}: Error finding container d85bb3ed47cd971ea5a5ca1cb83b5af60e8a58ab45e72d65ac76092eac1e1633: Status 404 returned error can't find the container with id d85bb3ed47cd971ea5a5ca1cb83b5af60e8a58ab45e72d65ac76092eac1e1633
May 27 20:19:47.005516 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.005496    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-252jm\" (UniqueName: \"kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm\") pod \"e5ddc063-806e-403f-870a-e1f7f9ca2975\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") "
May 27 20:19:47.005601 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.005528    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume\") pod \"e5ddc063-806e-403f-870a-e1f7f9ca2975\" (UID: \"e5ddc063-806e-403f-870a-e1f7f9ca2975\") "
May 27 20:19:47.005995 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.005975    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5ddc063-806e-403f-870a-e1f7f9ca2975" (UID: "e5ddc063-806e-403f-870a-e1f7f9ca2975"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:19:47.007327 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.007309    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm" (OuterVolumeSpecName: "kube-api-access-252jm") pod "e5ddc063-806e-403f-870a-e1f7f9ca2975" (UID: "e5ddc063-806e-403f-870a-e1f7f9ca2975"). InnerVolumeSpecName "kube-api-access-252jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:19:47.106503 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.106479    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-252jm\" (UniqueName: \"kubernetes.io/projected/e5ddc063-806e-403f-870a-e1f7f9ca2975-kube-api-access-252jm\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:47.106503 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.106502    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc063-806e-403f-870a-e1f7f9ca2975-extensions-socket-volume\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:47.300184 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.300106    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x" event={"ID":"a9debb8e-f200-451e-9f9b-a2010318d5af","Type":"ContainerStarted","Data":"5e67e1b0fe65e83b12313baf2ee914b160c5e0c460390dd14ffb8feb7e61984e"}
May 27 20:19:47.301549 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.301524    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" event={"ID":"cdd80911-1041-4360-bc3f-c443ea774df4","Type":"ContainerStarted","Data":"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"}
May 27 20:19:47.301679 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.301554    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" event={"ID":"cdd80911-1041-4360-bc3f-c443ea774df4","Type":"ContainerStarted","Data":"5a7abad42f1d7889204cb95d99f7a68f36b848754f9454cd2fd98ca162f50b49"}
May 27 20:19:47.301679 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.301652    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:47.302619 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.302595    2565 generic.go:358] "Generic (PLEG): container finished" podID="e5ddc063-806e-403f-870a-e1f7f9ca2975" containerID="eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936" exitCode=0
May 27 20:19:47.302713 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.302642    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx"
May 27 20:19:47.302765 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.302645    2565 scope.go:117] "RemoveContainer" containerID="eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936"
May 27 20:19:47.304047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.304023    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" event={"ID":"3705ed72-a1f5-4b74-9599-9b054e9ef972","Type":"ContainerStarted","Data":"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"}
May 27 20:19:47.304167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.304053    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" event={"ID":"3705ed72-a1f5-4b74-9599-9b054e9ef972","Type":"ContainerStarted","Data":"d85bb3ed47cd971ea5a5ca1cb83b5af60e8a58ab45e72d65ac76092eac1e1633"}
May 27 20:19:47.304214 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.304165    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:47.310936 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.310921    2565 scope.go:117] "RemoveContainer" containerID="eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936"
May 27 20:19:47.311180 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:19:47.311162    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936\": container with ID starting with eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936 not found: ID does not exist" containerID="eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936"
May 27 20:19:47.311247 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.311192    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936"} err="failed to get container status \"eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936\": rpc error: code = NotFound desc = could not find container \"eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936\": container with ID starting with eabb57f88aad9639b2141ec5f0682e79c2fd77c6bf5ea4fdf2dcc0ef0a1c0936 not found: ID does not exist"
May 27 20:19:47.316153 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.316119    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-t4z8x" podStartSLOduration=2.211432768 podStartE2EDuration="25.316109123s" podCreationTimestamp="2026-05-27 20:19:22 +0000 UTC" firstStartedPulling="2026-05-27 20:19:23.735277181 +0000 UTC m=+556.726649015" lastFinishedPulling="2026-05-27 20:19:46.839953529 +0000 UTC m=+579.831325370" observedRunningTime="2026-05-27 20:19:47.315683898 +0000 UTC m=+580.307055752" watchObservedRunningTime="2026-05-27 20:19:47.316109123 +0000 UTC m=+580.307480977"
May 27 20:19:47.317732 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.317710    2565 status_manager.go:895] "Failed to get status for pod" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:47.339304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.339257    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" podStartSLOduration=13.339240722 podStartE2EDuration="13.339240722s" podCreationTimestamp="2026-05-27 20:19:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:19:47.337048815 +0000 UTC m=+580.328420669" watchObservedRunningTime="2026-05-27 20:19:47.339240722 +0000 UTC m=+580.330612578"
May 27 20:19:47.358274 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.358233    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" podStartSLOduration=14.358210342 podStartE2EDuration="14.358210342s" podCreationTimestamp="2026-05-27 20:19:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:19:47.356038442 +0000 UTC m=+580.347410296" watchObservedRunningTime="2026-05-27 20:19:47.358210342 +0000 UTC m=+580.349582198"
May 27 20:19:47.358408 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.358296    2565 status_manager.go:895] "Failed to get status for pod" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:47.631012 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.630938    2565 status_manager.go:895] "Failed to get status for pod" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wtxtx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-wtxtx\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:47.631281 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:47.631261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ddc063-806e-403f-870a-e1f7f9ca2975" path="/var/lib/kubelet/pods/e5ddc063-806e-403f-870a-e1f7f9ca2975/volumes"
May 27 20:19:49.270566 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:49.270534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791c5967_f858_4fad_ac4d_f24872370e9f.slice/crio-551b27a2e0c8920d175388cdc9d60b1a8b676469253a835d43f2ee134b194614 WatchSource:0}: Error finding container 551b27a2e0c8920d175388cdc9d60b1a8b676469253a835d43f2ee134b194614: Status 404 returned error can't find the container with id 551b27a2e0c8920d175388cdc9d60b1a8b676469253a835d43f2ee134b194614
May 27 20:19:50.316963 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.316940    2565 generic.go:358] "Generic (PLEG): container finished" podID="791c5967-f858-4fad-ac4d-f24872370e9f" containerID="529ba8cbc1603651152a318cec992fa68df97f54c9994450d31f26147b332d30" exitCode=1
May 27 20:19:50.319334 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.319310    2565 status_manager.go:895] "Failed to get status for pod" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:50.346785 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.346768    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:50.348957 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.348936    2565 status_manager.go:895] "Failed to get status for pod" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:50.433922 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.433901    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume\") pod \"791c5967-f858-4fad-ac4d-f24872370e9f\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") "
May 27 20:19:50.434000 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.433986    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4nvq\" (UniqueName: \"kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq\") pod \"791c5967-f858-4fad-ac4d-f24872370e9f\" (UID: \"791c5967-f858-4fad-ac4d-f24872370e9f\") "
May 27 20:19:50.434186 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.434168    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "791c5967-f858-4fad-ac4d-f24872370e9f" (UID: "791c5967-f858-4fad-ac4d-f24872370e9f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:19:50.435888 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.435865    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq" (OuterVolumeSpecName: "kube-api-access-l4nvq") pod "791c5967-f858-4fad-ac4d-f24872370e9f" (UID: "791c5967-f858-4fad-ac4d-f24872370e9f"). InnerVolumeSpecName "kube-api-access-l4nvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:19:50.534748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.534715    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4nvq\" (UniqueName: \"kubernetes.io/projected/791c5967-f858-4fad-ac4d-f24872370e9f-kube-api-access-l4nvq\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:50.534748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:50.534745    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/791c5967-f858-4fad-ac4d-f24872370e9f-extensions-socket-volume\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:51.321150 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:51.321119    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps"
May 27 20:19:51.321150 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:51.321129    2565 scope.go:117] "RemoveContainer" containerID="529ba8cbc1603651152a318cec992fa68df97f54c9994450d31f26147b332d30"
May 27 20:19:51.323478 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:51.323451    2565 status_manager.go:895] "Failed to get status for pod" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:51.331033 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:51.331010    2565 status_manager.go:895] "Failed to get status for pod" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-j48ps" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-j48ps\" is forbidden: User \"system:node:ip-10-0-129-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-19.ec2.internal' and this object"
May 27 20:19:51.630371 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:51.630310    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" path="/var/lib/kubelet/pods/791c5967-f858-4fad-ac4d-f24872370e9f/volumes"
May 27 20:19:55.987810 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:55.987779    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:19:58.310400 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.310368    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:19:58.310870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.310537    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:58.389876 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.389848    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:58.390045 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.390026    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" podUID="3705ed72-a1f5-4b74-9599-9b054e9ef972" containerName="manager" containerID="cri-o://e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871" gracePeriod=10
May 27 20:19:58.629582 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.629552    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:58.700570 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.700539    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g7r7\" (UniqueName: \"kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7\") pod \"3705ed72-a1f5-4b74-9599-9b054e9ef972\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") "
May 27 20:19:58.700748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.700594    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume\") pod \"3705ed72-a1f5-4b74-9599-9b054e9ef972\" (UID: \"3705ed72-a1f5-4b74-9599-9b054e9ef972\") "
May 27 20:19:58.700947 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.700926    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3705ed72-a1f5-4b74-9599-9b054e9ef972" (UID: "3705ed72-a1f5-4b74-9599-9b054e9ef972"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:19:58.702881 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.702858    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7" (OuterVolumeSpecName: "kube-api-access-6g7r7") pod "3705ed72-a1f5-4b74-9599-9b054e9ef972" (UID: "3705ed72-a1f5-4b74-9599-9b054e9ef972"). InnerVolumeSpecName "kube-api-access-6g7r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:19:58.706470 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.706445    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:19:58.706891 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.706869    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3705ed72-a1f5-4b74-9599-9b054e9ef972" containerName="manager"
May 27 20:19:58.706891 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.706888    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3705ed72-a1f5-4b74-9599-9b054e9ef972" containerName="manager"
May 27 20:19:58.707026 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.706902    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" containerName="manager"
May 27 20:19:58.707026 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.706909    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" containerName="manager"
May 27 20:19:58.707115 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.707025    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="791c5967-f858-4fad-ac4d-f24872370e9f" containerName="manager"
May 27 20:19:58.707115 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.707040    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="3705ed72-a1f5-4b74-9599-9b054e9ef972" containerName="manager"
May 27 20:19:58.710177 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.710159    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.725439 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.725419    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:19:58.801752 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.801721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dgv9\" (UniqueName: \"kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.801852 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.801766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.801852 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.801820    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g7r7\" (UniqueName: \"kubernetes.io/projected/3705ed72-a1f5-4b74-9599-9b054e9ef972-kube-api-access-6g7r7\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:58.801852 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.801834    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3705ed72-a1f5-4b74-9599-9b054e9ef972-extensions-socket-volume\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:19:58.902554 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.902496    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dgv9\" (UniqueName: \"kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.902554 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.902534    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.902822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.902808    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:58.915099 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:58.915075    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dgv9\" (UniqueName: \"kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7qgkl\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:59.019529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.019507    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:59.150924 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.150899    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:19:59.152828 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:19:59.152779    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82c0954_0051_430e_ba45_956ef3925e3a.slice/crio-3d274f9a85c6b7c005f70fad9f85c15a81ed366d54be6ebe20c707d76b301048 WatchSource:0}: Error finding container 3d274f9a85c6b7c005f70fad9f85c15a81ed366d54be6ebe20c707d76b301048: Status 404 returned error can't find the container with id 3d274f9a85c6b7c005f70fad9f85c15a81ed366d54be6ebe20c707d76b301048
May 27 20:19:59.348191 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.348162    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" event={"ID":"a82c0954-0051-430e-ba45-956ef3925e3a","Type":"ContainerStarted","Data":"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"}
May 27 20:19:59.348579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.348206    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:19:59.348579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.348221    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" event={"ID":"a82c0954-0051-430e-ba45-956ef3925e3a","Type":"ContainerStarted","Data":"3d274f9a85c6b7c005f70fad9f85c15a81ed366d54be6ebe20c707d76b301048"}
May 27 20:19:59.349304 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.349268    2565 generic.go:358] "Generic (PLEG): container finished" podID="3705ed72-a1f5-4b74-9599-9b054e9ef972" containerID="e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871" exitCode=0
May 27 20:19:59.349435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.349313    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" event={"ID":"3705ed72-a1f5-4b74-9599-9b054e9ef972","Type":"ContainerDied","Data":"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"}
May 27 20:19:59.349435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.349317    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"
May 27 20:19:59.349435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.349334    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4" event={"ID":"3705ed72-a1f5-4b74-9599-9b054e9ef972","Type":"ContainerDied","Data":"d85bb3ed47cd971ea5a5ca1cb83b5af60e8a58ab45e72d65ac76092eac1e1633"}
May 27 20:19:59.349435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.349374    2565 scope.go:117] "RemoveContainer" containerID="e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"
May 27 20:19:59.357083 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.357064    2565 scope.go:117] "RemoveContainer" containerID="e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"
May 27 20:19:59.357338 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:19:59.357314    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871\": container with ID starting with e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871 not found: ID does not exist" containerID="e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"
May 27 20:19:59.357440 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.357382    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871"} err="failed to get container status \"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871\": rpc error: code = NotFound desc = could not find container \"e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871\": container with ID starting with e09242419027b46b8a0fa4f2ce5ff1ba4b974e652ce414d60380ab0889651871 not found: ID does not exist"
May 27 20:19:59.368890 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.368844    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" podStartSLOduration=1.368834371 podStartE2EDuration="1.368834371s" podCreationTimestamp="2026-05-27 20:19:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:19:59.366723543 +0000 UTC m=+592.358095399" watchObservedRunningTime="2026-05-27 20:19:59.368834371 +0000 UTC m=+592.360206225"
May 27 20:19:59.392483 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.392465    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:59.402098 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.402070    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-nnmq4"]
May 27 20:19:59.630386 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:19:59.630338    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3705ed72-a1f5-4b74-9599-9b054e9ef972" path="/var/lib/kubelet/pods/3705ed72-a1f5-4b74-9599-9b054e9ef972/volumes"
May 27 20:20:10.355811 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:10.355778    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:20:10.403014 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:10.402980    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:20:10.403266 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:10.403226    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" podUID="cdd80911-1041-4360-bc3f-c443ea774df4" containerName="manager" containerID="cri-o://ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e" gracePeriod=10
May 27 20:20:11.173138 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.173117    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:20:11.294738 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.294680    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7wms\" (UniqueName: \"kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms\") pod \"cdd80911-1041-4360-bc3f-c443ea774df4\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") "
May 27 20:20:11.294872 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.294756    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume\") pod \"cdd80911-1041-4360-bc3f-c443ea774df4\" (UID: \"cdd80911-1041-4360-bc3f-c443ea774df4\") "
May 27 20:20:11.295052 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.295032    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cdd80911-1041-4360-bc3f-c443ea774df4" (UID: "cdd80911-1041-4360-bc3f-c443ea774df4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:20:11.296788 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.296767    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms" (OuterVolumeSpecName: "kube-api-access-r7wms") pod "cdd80911-1041-4360-bc3f-c443ea774df4" (UID: "cdd80911-1041-4360-bc3f-c443ea774df4"). InnerVolumeSpecName "kube-api-access-r7wms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:20:11.389496 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.389469    2565 generic.go:358] "Generic (PLEG): container finished" podID="cdd80911-1041-4360-bc3f-c443ea774df4" containerID="ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e" exitCode=0
May 27 20:20:11.389793 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.389536    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"
May 27 20:20:11.389793 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.389552    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" event={"ID":"cdd80911-1041-4360-bc3f-c443ea774df4","Type":"ContainerDied","Data":"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"}
May 27 20:20:11.389793 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.389596    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd" event={"ID":"cdd80911-1041-4360-bc3f-c443ea774df4","Type":"ContainerDied","Data":"5a7abad42f1d7889204cb95d99f7a68f36b848754f9454cd2fd98ca162f50b49"}
May 27 20:20:11.389793 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.389629    2565 scope.go:117] "RemoveContainer" containerID="ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"
May 27 20:20:11.395224 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.395205    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7wms\" (UniqueName: \"kubernetes.io/projected/cdd80911-1041-4360-bc3f-c443ea774df4-kube-api-access-r7wms\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:11.395224 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.395226    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd80911-1041-4360-bc3f-c443ea774df4-extensions-socket-volume\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:11.398844 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.398830    2565 scope.go:117] "RemoveContainer" containerID="ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"
May 27 20:20:11.399096 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:20:11.399078    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e\": container with ID starting with ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e not found: ID does not exist" containerID="ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"
May 27 20:20:11.399153 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.399105    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e"} err="failed to get container status \"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e\": rpc error: code = NotFound desc = could not find container \"ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e\": container with ID starting with ff13e5499f767174d797add180285425fb6350cc7084ad9ec6b2d31715dbb82e not found: ID does not exist"
May 27 20:20:11.410759 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.410738    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:20:11.420992 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.420967    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-zjbhd"]
May 27 20:20:11.630468 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:11.630413    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdd80911-1041-4360-bc3f-c443ea774df4" path="/var/lib/kubelet/pods/cdd80911-1041-4360-bc3f-c443ea774df4/volumes"
May 27 20:20:14.695216 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.695188    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"]
May 27 20:20:14.695790 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.695636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdd80911-1041-4360-bc3f-c443ea774df4" containerName="manager"
May 27 20:20:14.695790 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.695650    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdd80911-1041-4360-bc3f-c443ea774df4" containerName="manager"
May 27 20:20:14.695790 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.695727    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cdd80911-1041-4360-bc3f-c443ea774df4" containerName="manager"
May 27 20:20:14.768129 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.768101    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"]
May 27 20:20:14.768255 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.768228    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.770807 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.770789    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8md9w\""
May 27 20:20:14.921822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.921795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.921933 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.921835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.921933 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.921867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6558f3d4-bd46-49db-85d8-48b28ef466b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922004 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.921952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922004 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.921994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922076 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.922013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkds\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-kube-api-access-clkds\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922076 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.922060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922151 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.922098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:14.922151 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:14.922116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023075 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023053    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023174 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023087    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023174 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023102    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clkds\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-kube-api-access-clkds\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023174 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023126    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023174 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023147    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023388 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023280    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023388 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023360    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023489 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023407    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023489 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023432    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023507    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6558f3d4-bd46-49db-85d8-48b28ef466b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023696 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023676    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.023732 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.024013 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.023999    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6558f3d4-bd46-49db-85d8-48b28ef466b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.025245 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.025226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.025526 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.025510    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.031937 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.031912    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.032187 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.032172    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkds\" (UniqueName: \"kubernetes.io/projected/6558f3d4-bd46-49db-85d8-48b28ef466b0-kube-api-access-clkds\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-fj5dr\" (UID: \"6558f3d4-bd46-49db-85d8-48b28ef466b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.078168 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.078144    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:15.209007 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.208983    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"]
May 27 20:20:15.210996 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:20:15.210964    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6558f3d4_bd46_49db_85d8_48b28ef466b0.slice/crio-aec2e17de64ea0fd6438a40bb3588970de872a56581c22c30f395e1c3b7880c9 WatchSource:0}: Error finding container aec2e17de64ea0fd6438a40bb3588970de872a56581c22c30f395e1c3b7880c9: Status 404 returned error can't find the container with id aec2e17de64ea0fd6438a40bb3588970de872a56581c22c30f395e1c3b7880c9
May 27 20:20:15.213444 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.213410    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:20:15.213523 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.213474    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:20:15.213523 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.213512    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 27 20:20:15.407850 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.407818    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr" event={"ID":"6558f3d4-bd46-49db-85d8-48b28ef466b0","Type":"ContainerStarted","Data":"fd92022869aadc0612a27e72665e733a5bdf37c1c10572e26a537c2e73ff59eb"}
May 27 20:20:15.407850 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.407854    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr" event={"ID":"6558f3d4-bd46-49db-85d8-48b28ef466b0","Type":"ContainerStarted","Data":"aec2e17de64ea0fd6438a40bb3588970de872a56581c22c30f395e1c3b7880c9"}
May 27 20:20:15.429827 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:15.429780    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr" podStartSLOduration=1.4297662899999999 podStartE2EDuration="1.42976629s" podCreationTimestamp="2026-05-27 20:20:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:20:15.427769661 +0000 UTC m=+608.419141530" watchObservedRunningTime="2026-05-27 20:20:15.42976629 +0000 UTC m=+608.421138146"
May 27 20:20:16.078430 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:16.078402    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:16.082719 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:16.082696    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:16.411179 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:16.411121    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:16.411773 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:16.411758    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-fj5dr"
May 27 20:20:21.011573 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.011538    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f64d7776d-vnqrb" podUID="76e1d419-ff4f-47dd-ba52-272709c4b143" containerName="console" containerID="cri-o://b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce" gracePeriod=15
May 27 20:20:21.255320 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.255301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f64d7776d-vnqrb_76e1d419-ff4f-47dd-ba52-272709c4b143/console/0.log"
May 27 20:20:21.255438 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.255379    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:20:21.371836 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371782    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.371836 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371814    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.371836 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371834    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.372047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371855    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.372047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371872    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hbvp\" (UniqueName: \"kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.372047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371904    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.372047 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.371979    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config\") pod \"76e1d419-ff4f-47dd-ba52-272709c4b143\" (UID: \"76e1d419-ff4f-47dd-ba52-272709c4b143\") "
May 27 20:20:21.372245 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.372216    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca" (OuterVolumeSpecName: "service-ca") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:20:21.372245 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.372232    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:20:21.372328 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.372226    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:20:21.372513 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.372493    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config" (OuterVolumeSpecName: "console-config") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 20:20:21.374114 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.374094    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp" (OuterVolumeSpecName: "kube-api-access-4hbvp") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "kube-api-access-4hbvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:20:21.374565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.374543    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:20:21.374565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.374556    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76e1d419-ff4f-47dd-ba52-272709c4b143" (UID: "76e1d419-ff4f-47dd-ba52-272709c4b143"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 20:20:21.430117 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f64d7776d-vnqrb_76e1d419-ff4f-47dd-ba52-272709c4b143/console/0.log"
May 27 20:20:21.430206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430133    2565 generic.go:358] "Generic (PLEG): container finished" podID="76e1d419-ff4f-47dd-ba52-272709c4b143" containerID="b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce" exitCode=2
May 27 20:20:21.430206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430171    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f64d7776d-vnqrb" event={"ID":"76e1d419-ff4f-47dd-ba52-272709c4b143","Type":"ContainerDied","Data":"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"}
May 27 20:20:21.430290 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430202    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f64d7776d-vnqrb"
May 27 20:20:21.430290 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430216    2565 scope.go:117] "RemoveContainer" containerID="b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"
May 27 20:20:21.430290 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.430206    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f64d7776d-vnqrb" event={"ID":"76e1d419-ff4f-47dd-ba52-272709c4b143","Type":"ContainerDied","Data":"e59a22800fce2588a4d7336c967be58abeef95fb8f5aaa98677b793ef817c322"}
May 27 20:20:21.438401 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.438368    2565 scope.go:117] "RemoveContainer" containerID="b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"
May 27 20:20:21.438620 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:20:21.438602    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce\": container with ID starting with b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce not found: ID does not exist" containerID="b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"
May 27 20:20:21.438671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.438628    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce"} err="failed to get container status \"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce\": rpc error: code = NotFound desc = could not find container \"b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce\": container with ID starting with b0560488a34be84bf548c5ccff18b022b715d102b95b94377a2206e8d1bc40ce not found: ID does not exist"
May 27 20:20:21.450447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.450429    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:20:21.454058 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.454038    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f64d7776d-vnqrb"]
May 27 20:20:21.472729 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472710    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-console-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472728    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-oauth-config\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472738    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-trusted-ca-bundle\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472753    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-service-ca\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472763    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76e1d419-ff4f-47dd-ba52-272709c4b143-oauth-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472770    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hbvp\" (UniqueName: \"kubernetes.io/projected/76e1d419-ff4f-47dd-ba52-272709c4b143-kube-api-access-4hbvp\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.472782 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.472780    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76e1d419-ff4f-47dd-ba52-272709c4b143-console-serving-cert\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:20:21.629446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:21.629392    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76e1d419-ff4f-47dd-ba52-272709c4b143" path="/var/lib/kubelet/pods/76e1d419-ff4f-47dd-ba52-272709c4b143/volumes"
May 27 20:20:30.806991 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.806919    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:20:30.807314 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.807300    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e1d419-ff4f-47dd-ba52-272709c4b143" containerName="console"
May 27 20:20:30.807374 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.807317    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e1d419-ff4f-47dd-ba52-272709c4b143" containerName="console"
May 27 20:20:30.807415 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.807394    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="76e1d419-ff4f-47dd-ba52-272709c4b143" containerName="console"
May 27 20:20:30.810446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.810426    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:30.812714 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.812693    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 27 20:20:30.816807 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.816783    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:20:30.840517 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.840493    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:20:30.942870 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.942845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgcr\" (UniqueName: \"kubernetes.io/projected/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-kube-api-access-hdgcr\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:30.942962 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:30.942902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-config-file\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.043734 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.043710    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-config-file\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.043828 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.043759    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgcr\" (UniqueName: \"kubernetes.io/projected/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-kube-api-access-hdgcr\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.044270 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.044250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-config-file\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.051946 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.051919    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgcr\" (UniqueName: \"kubernetes.io/projected/1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe-kube-api-access-hdgcr\") pod \"limitador-limitador-78c99df468-vwmzq\" (UID: \"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe\") " pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.121417 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.121372    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:31.245191 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.245163    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:20:31.249135 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:20:31.249109    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe006a1_66e3_49a6_b6ca_c0f80e7f62fe.slice/crio-189db9a3a009d5aa542c0019ffaaac5f657305bfb5525364d31ed64231433d14 WatchSource:0}: Error finding container 189db9a3a009d5aa542c0019ffaaac5f657305bfb5525364d31ed64231433d14: Status 404 returned error can't find the container with id 189db9a3a009d5aa542c0019ffaaac5f657305bfb5525364d31ed64231433d14
May 27 20:20:31.462637 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.462577    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq" event={"ID":"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe","Type":"ContainerStarted","Data":"189db9a3a009d5aa542c0019ffaaac5f657305bfb5525364d31ed64231433d14"}
May 27 20:20:31.499525 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.499500    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:20:31.504178 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.504161    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:20:31.506823 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.506790    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q6klp\""
May 27 20:20:31.509131 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.509108    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:20:31.649063 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.649043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz4bs\" (UniqueName: \"kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs\") pod \"authorino-7498df8756-zqpwb\" (UID: \"48e46094-4bf8-49c9-bbb6-602ade89e3e9\") " pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:20:31.750447 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.750416    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kz4bs\" (UniqueName: \"kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs\") pod \"authorino-7498df8756-zqpwb\" (UID: \"48e46094-4bf8-49c9-bbb6-602ade89e3e9\") " pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:20:31.763929 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.763906    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz4bs\" (UniqueName: \"kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs\") pod \"authorino-7498df8756-zqpwb\" (UID: \"48e46094-4bf8-49c9-bbb6-602ade89e3e9\") " pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:20:31.814878 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.814470    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:20:31.995856 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:31.995772    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:20:31.998683 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:20:31.998647    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48e46094_4bf8_49c9_bbb6_602ade89e3e9.slice/crio-aab0f443c8d27d6fdfc886da89e7ccd31000924e92a2827974697d5318399f7d WatchSource:0}: Error finding container aab0f443c8d27d6fdfc886da89e7ccd31000924e92a2827974697d5318399f7d: Status 404 returned error can't find the container with id aab0f443c8d27d6fdfc886da89e7ccd31000924e92a2827974697d5318399f7d
May 27 20:20:32.467938 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:32.467859    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zqpwb" event={"ID":"48e46094-4bf8-49c9-bbb6-602ade89e3e9","Type":"ContainerStarted","Data":"aab0f443c8d27d6fdfc886da89e7ccd31000924e92a2827974697d5318399f7d"}
May 27 20:20:36.483763 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:36.483726    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq" event={"ID":"1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe","Type":"ContainerStarted","Data":"f94a0d0ca3d26adbab3607f17724180c27ba31a6cebb6e89fe5e20b323d6702e"}
May 27 20:20:36.484166 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:36.483847    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:20:36.485038 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:36.485009    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zqpwb" event={"ID":"48e46094-4bf8-49c9-bbb6-602ade89e3e9","Type":"ContainerStarted","Data":"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"}
May 27 20:20:36.500293 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:36.500246    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq" podStartSLOduration=2.259322658 podStartE2EDuration="6.50023493s" podCreationTimestamp="2026-05-27 20:20:30 +0000 UTC" firstStartedPulling="2026-05-27 20:20:31.250858759 +0000 UTC m=+624.242230593" lastFinishedPulling="2026-05-27 20:20:35.491771022 +0000 UTC m=+628.483142865" observedRunningTime="2026-05-27 20:20:36.498137167 +0000 UTC m=+629.489509023" watchObservedRunningTime="2026-05-27 20:20:36.50023493 +0000 UTC m=+629.491606820"
May 27 20:20:36.512247 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:36.512208    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-zqpwb" podStartSLOduration=2.012049924 podStartE2EDuration="5.512196594s" podCreationTimestamp="2026-05-27 20:20:31 +0000 UTC" firstStartedPulling="2026-05-27 20:20:32.000339169 +0000 UTC m=+624.991711020" lastFinishedPulling="2026-05-27 20:20:35.500485853 +0000 UTC m=+628.491857690" observedRunningTime="2026-05-27 20:20:36.5107323 +0000 UTC m=+629.502104159" watchObservedRunningTime="2026-05-27 20:20:36.512196594 +0000 UTC m=+629.503568448"
May 27 20:20:47.491796 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:20:47.491764    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-vwmzq"
May 27 20:21:04.210483 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.210445    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:21:04.211034 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.210661    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-zqpwb" podUID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" containerName="authorino" containerID="cri-o://251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9" gracePeriod=30
May 27 20:21:04.475543 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.475515    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:21:04.575704 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.575676    2565 generic.go:358] "Generic (PLEG): container finished" podID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" containerID="251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9" exitCode=0
May 27 20:21:04.575822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.575709    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zqpwb" event={"ID":"48e46094-4bf8-49c9-bbb6-602ade89e3e9","Type":"ContainerDied","Data":"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"}
May 27 20:21:04.575822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.575735    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zqpwb"
May 27 20:21:04.575822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.575749    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zqpwb" event={"ID":"48e46094-4bf8-49c9-bbb6-602ade89e3e9","Type":"ContainerDied","Data":"aab0f443c8d27d6fdfc886da89e7ccd31000924e92a2827974697d5318399f7d"}
May 27 20:21:04.575822 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.575770    2565 scope.go:117] "RemoveContainer" containerID="251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"
May 27 20:21:04.583564 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.583551    2565 scope.go:117] "RemoveContainer" containerID="251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"
May 27 20:21:04.583787 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:21:04.583766    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9\": container with ID starting with 251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9 not found: ID does not exist" containerID="251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"
May 27 20:21:04.583846 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.583799    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9"} err="failed to get container status \"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9\": rpc error: code = NotFound desc = could not find container \"251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9\": container with ID starting with 251268b60b7df10e15a1e66b8565026536c8fd7647576b4da8bf16f9a46276b9 not found: ID does not exist"
May 27 20:21:04.598597 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.598579    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz4bs\" (UniqueName: \"kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs\") pod \"48e46094-4bf8-49c9-bbb6-602ade89e3e9\" (UID: \"48e46094-4bf8-49c9-bbb6-602ade89e3e9\") "
May 27 20:21:04.600751 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.600728    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs" (OuterVolumeSpecName: "kube-api-access-kz4bs") pod "48e46094-4bf8-49c9-bbb6-602ade89e3e9" (UID: "48e46094-4bf8-49c9-bbb6-602ade89e3e9"). InnerVolumeSpecName "kube-api-access-kz4bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:21:04.699270 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.699249    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz4bs\" (UniqueName: \"kubernetes.io/projected/48e46094-4bf8-49c9-bbb6-602ade89e3e9-kube-api-access-kz4bs\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:21:04.898428 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.898397    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:21:04.901815 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:04.901795    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-zqpwb"]
May 27 20:21:05.630071 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:05.630045    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" path="/var/lib/kubelet/pods/48e46094-4bf8-49c9-bbb6-602ade89e3e9/volumes"
May 27 20:21:07.572202 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:07.572172    2565 scope.go:117] "RemoveContainer" containerID="287c6c66a9a56cc4b2ceee2786d615867b876a2b90e4da2ce379902b9488207b"
May 27 20:21:39.757515 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:21:39.757484    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:03.853042 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:03.852967    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:07.486123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:07.486085    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:10.702610 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.702577    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"]
May 27 20:22:10.702973 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.702958    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" containerName="authorino"
May 27 20:22:10.703018 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.702976    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" containerName="authorino"
May 27 20:22:10.703049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.703031    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="48e46094-4bf8-49c9-bbb6-602ade89e3e9" containerName="authorino"
May 27 20:22:10.710510 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.710485    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.715770 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.715749    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 20:22:10.717002 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.716849    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 27 20:22:10.717002 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.716961    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t7lk5\""
May 27 20:22:10.717137 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.716987    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 20:22:10.725805 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.725785    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"]
May 27 20:22:10.784892 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.784865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.785049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.784906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fv6x\" (UniqueName: \"kubernetes.io/projected/8fbf9484-9959-439c-9eaa-5808d0215e36-kube-api-access-9fv6x\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.785049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.784931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.785049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.785007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.785049 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.785036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbf9484-9959-439c-9eaa-5808d0215e36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.785204 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.785066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886247 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886219    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886407 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886270    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fv6x\" (UniqueName: \"kubernetes.io/projected/8fbf9484-9959-439c-9eaa-5808d0215e36-kube-api-access-9fv6x\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886407 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886309    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886407 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886383    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886407 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886405    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbf9484-9959-439c-9eaa-5808d0215e36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886613 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886433    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886613 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886810 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886784    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.886904 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.886848    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.888685 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.888665    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbf9484-9959-439c-9eaa-5808d0215e36-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.888820 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.888803    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbf9484-9959-439c-9eaa-5808d0215e36-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:10.894405 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:10.894386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fv6x\" (UniqueName: \"kubernetes.io/projected/8fbf9484-9959-439c-9eaa-5808d0215e36-kube-api-access-9fv6x\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-wjhvj\" (UID: \"8fbf9484-9959-439c-9eaa-5808d0215e36\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:11.021241 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:11.021206    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:11.153918 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:11.153891    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"]
May 27 20:22:11.155126 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:22:11.155100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbf9484_9959_439c_9eaa_5808d0215e36.slice/crio-c53cb1d81c021b231ba14ed72b31a3225a32f3c54ab7af7c39cee3c1739a9519 WatchSource:0}: Error finding container c53cb1d81c021b231ba14ed72b31a3225a32f3c54ab7af7c39cee3c1739a9519: Status 404 returned error can't find the container with id c53cb1d81c021b231ba14ed72b31a3225a32f3c54ab7af7c39cee3c1739a9519
May 27 20:22:11.156889 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:11.156870    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 20:22:11.784180 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:11.784147    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj" event={"ID":"8fbf9484-9959-439c-9eaa-5808d0215e36","Type":"ContainerStarted","Data":"c53cb1d81c021b231ba14ed72b31a3225a32f3c54ab7af7c39cee3c1739a9519"}
May 27 20:22:11.993368 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:11.993319    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:16.805959 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:16.805926    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj" event={"ID":"8fbf9484-9959-439c-9eaa-5808d0215e36","Type":"ContainerStarted","Data":"d539eb49978fa641f173987d60b63f28a18fc40361c65ec3789c1556a33bbb19"}
May 27 20:22:18.000041 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:18.000009    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:21.824529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:21.824499    2565 generic.go:358] "Generic (PLEG): container finished" podID="8fbf9484-9959-439c-9eaa-5808d0215e36" containerID="d539eb49978fa641f173987d60b63f28a18fc40361c65ec3789c1556a33bbb19" exitCode=0
May 27 20:22:21.824858 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:21.824569    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj" event={"ID":"8fbf9484-9959-439c-9eaa-5808d0215e36","Type":"ContainerDied","Data":"d539eb49978fa641f173987d60b63f28a18fc40361c65ec3789c1556a33bbb19"}
May 27 20:22:23.833466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:23.833434    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj" event={"ID":"8fbf9484-9959-439c-9eaa-5808d0215e36","Type":"ContainerStarted","Data":"9243f9bd8005d67b3d7a42595ed6a29737b505265724cfb0c93b785a034b6d52"}
May 27 20:22:23.833841 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:23.833640    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:23.854809 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:23.854758    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj" podStartSLOduration=2.081169396 podStartE2EDuration="13.854734584s" podCreationTimestamp="2026-05-27 20:22:10 +0000 UTC" firstStartedPulling="2026-05-27 20:22:11.156990294 +0000 UTC m=+724.148362130" lastFinishedPulling="2026-05-27 20:22:22.930555484 +0000 UTC m=+735.921927318" observedRunningTime="2026-05-27 20:22:23.853071005 +0000 UTC m=+736.844442863" watchObservedRunningTime="2026-05-27 20:22:23.854734584 +0000 UTC m=+736.846106433"
May 27 20:22:34.850322 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:34.850293    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-wjhvj"
May 27 20:22:37.952050 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:37.952010    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"]
May 27 20:22:37.972415 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:37.972387    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"]
May 27 20:22:37.972554 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:37.972496    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:37.974893 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:37.974869    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 27 20:22:38.116294 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db14c7b-d322-45c2-adba-910537706f5b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.116435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.116435 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.116529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.116529 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.116596 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.116571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bskc\" (UniqueName: \"kubernetes.io/projected/6db14c7b-d322-45c2-adba-910537706f5b-kube-api-access-2bskc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217643 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217566    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db14c7b-d322-45c2-adba-910537706f5b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217643 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217605    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217802 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217658    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217802 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217686    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217802 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217708    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.217802 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.217732    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bskc\" (UniqueName: \"kubernetes.io/projected/6db14c7b-d322-45c2-adba-910537706f5b-kube-api-access-2bskc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.218068 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.218049    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.218151 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.218131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.218208 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.218171    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.219908 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.219893    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db14c7b-d322-45c2-adba-910537706f5b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.220178 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.220154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db14c7b-d322-45c2-adba-910537706f5b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.227369 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.225277    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bskc\" (UniqueName: \"kubernetes.io/projected/6db14c7b-d322-45c2-adba-910537706f5b-kube-api-access-2bskc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4\" (UID: \"6db14c7b-d322-45c2-adba-910537706f5b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.282497 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.282473    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:38.408113 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.408084    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"]
May 27 20:22:38.409884 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:22:38.409857    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db14c7b_d322_45c2_adba_910537706f5b.slice/crio-eb90607b954e68dba2eb91fbddf33665f6f33da581b8a019153aa31484899467 WatchSource:0}: Error finding container eb90607b954e68dba2eb91fbddf33665f6f33da581b8a019153aa31484899467: Status 404 returned error can't find the container with id eb90607b954e68dba2eb91fbddf33665f6f33da581b8a019153aa31484899467
May 27 20:22:38.692694 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.692663    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:38.888583 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.888552    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4" event={"ID":"6db14c7b-d322-45c2-adba-910537706f5b","Type":"ContainerStarted","Data":"035f88618341aa48086db0fb6386d0698a23d23aa2e6a4c4382af399e599ea19"}
May 27 20:22:38.888583 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:38.888587    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4" event={"ID":"6db14c7b-d322-45c2-adba-910537706f5b","Type":"ContainerStarted","Data":"eb90607b954e68dba2eb91fbddf33665f6f33da581b8a019153aa31484899467"}
May 27 20:22:43.495321 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:43.495292    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:22:43.908110 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:43.908079    2565 generic.go:358] "Generic (PLEG): container finished" podID="6db14c7b-d322-45c2-adba-910537706f5b" containerID="035f88618341aa48086db0fb6386d0698a23d23aa2e6a4c4382af399e599ea19" exitCode=0
May 27 20:22:43.908297 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:43.908157    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4" event={"ID":"6db14c7b-d322-45c2-adba-910537706f5b","Type":"ContainerDied","Data":"035f88618341aa48086db0fb6386d0698a23d23aa2e6a4c4382af399e599ea19"}
May 27 20:22:44.913579 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:44.913547    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4" event={"ID":"6db14c7b-d322-45c2-adba-910537706f5b","Type":"ContainerStarted","Data":"363c1f34b4a97d6edf6d2a2eef7943c9f908bf6e1e0398acb0b2d252f7d220d2"}
May 27 20:22:44.913948 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:44.913780    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:22:44.934043 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:44.933999    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4" podStartSLOduration=7.66352958 podStartE2EDuration="7.933988341s" podCreationTimestamp="2026-05-27 20:22:37 +0000 UTC" firstStartedPulling="2026-05-27 20:22:43.908788252 +0000 UTC m=+756.900160086" lastFinishedPulling="2026-05-27 20:22:44.17924701 +0000 UTC m=+757.170618847" observedRunningTime="2026-05-27 20:22:44.932844475 +0000 UTC m=+757.924216340" watchObservedRunningTime="2026-05-27 20:22:44.933988341 +0000 UTC m=+757.925360197"
May 27 20:22:55.930336 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:22:55.930306    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4"
May 27 20:23:35.600668 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:23:35.600593    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:23:45.389369 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:23:45.389322    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:23:53.609230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:23:53.609194    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:24:04.388939 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:24:04.388903    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:24:13.505334 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:24:13.505298    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:24:24.594691 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:24:24.594658    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:24:55.288446 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:24:55.288414    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:25:00.397587 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:25:00.397507    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:25:27.395524 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:25:27.395489    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:25:43.892761 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:25:43.892728    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:26:06.388582 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:26:06.388543    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:26:25.394799 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:26:25.394764    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:26:37.790497 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:26:37.790462    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:26:53.396128 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:26:53.396094    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:27:48.487182 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:27:48.487145    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:27:57.490230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:27:57.490143    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:28:13.898158 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:28:13.898123    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:28:22.093306 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:28:22.093272    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:28:39.499837 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:28:39.499806    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:28:47.492089 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:28:47.492057    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:29:19.995847 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:29:19.995814    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:29:28.296078 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:29:28.296009    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:29:36.598014 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:29:36.597982    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:29:45.498277 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:29:45.498233    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:29:53.394095 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:29:53.394063    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:30:12.192289 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:30:12.192256    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:30:22.595772 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:30:22.595741    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:14.198757 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:14.198725    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:19.691518 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:19.691490    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:25.695445 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:25.695411    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:33.994768 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:33.994723    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:43.699890 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:43.699857    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:31:51.503330 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:31:51.503292    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:00.692395 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:00.692367    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:09.193794 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:09.193760    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:18.600705 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:18.600671    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:26.795051 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:26.795019    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:35.491113 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:35.491075    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:44.596206 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:44.596174    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:32:53.196019 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:32:53.195967    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:33:01.695603 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:33:01.695570    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:33:09.892191 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:33:09.892159    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:33:19.503252 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:33:19.503220    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:33:28.112132 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:33:28.112096    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:33:36.200513 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:33:36.200478    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:34:27.812467 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:27.812391    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:34:27.812976 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:27.812629    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" podUID="a82c0954-0051-430e-ba45-956ef3925e3a" containerName="manager" containerID="cri-o://1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477" gracePeriod=10
May 27 20:34:28.069329 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.069273    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:34:28.144992 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.144961    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dgv9\" (UniqueName: \"kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9\") pod \"a82c0954-0051-430e-ba45-956ef3925e3a\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") "
May 27 20:34:28.144992 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.144994    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume\") pod \"a82c0954-0051-430e-ba45-956ef3925e3a\" (UID: \"a82c0954-0051-430e-ba45-956ef3925e3a\") "
May 27 20:34:28.145408 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.145373    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a82c0954-0051-430e-ba45-956ef3925e3a" (UID: "a82c0954-0051-430e-ba45-956ef3925e3a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 20:34:28.146978 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.146954    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9" (OuterVolumeSpecName: "kube-api-access-9dgv9") pod "a82c0954-0051-430e-ba45-956ef3925e3a" (UID: "a82c0954-0051-430e-ba45-956ef3925e3a"). InnerVolumeSpecName "kube-api-access-9dgv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 20:34:28.245810 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.245783    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dgv9\" (UniqueName: \"kubernetes.io/projected/a82c0954-0051-430e-ba45-956ef3925e3a-kube-api-access-9dgv9\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:34:28.245810 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.245807    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82c0954-0051-430e-ba45-956ef3925e3a-extensions-socket-volume\") on node \"ip-10-0-129-19.ec2.internal\" DevicePath \"\""
May 27 20:34:28.330454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.330390    2565 generic.go:358] "Generic (PLEG): container finished" podID="a82c0954-0051-430e-ba45-956ef3925e3a" containerID="1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477" exitCode=0
May 27 20:34:28.330454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.330444    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" event={"ID":"a82c0954-0051-430e-ba45-956ef3925e3a","Type":"ContainerDied","Data":"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"}
May 27 20:34:28.330588 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.330457    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"
May 27 20:34:28.330588 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.330466    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl" event={"ID":"a82c0954-0051-430e-ba45-956ef3925e3a","Type":"ContainerDied","Data":"3d274f9a85c6b7c005f70fad9f85c15a81ed366d54be6ebe20c707d76b301048"}
May 27 20:34:28.330588 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.330483    2565 scope.go:117] "RemoveContainer" containerID="1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"
May 27 20:34:28.339390 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.339374    2565 scope.go:117] "RemoveContainer" containerID="1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"
May 27 20:34:28.339639 ip-10-0-129-19 kubenswrapper[2565]: E0527 20:34:28.339619    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477\": container with ID starting with 1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477 not found: ID does not exist" containerID="1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"
May 27 20:34:28.339682 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.339647    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477"} err="failed to get container status \"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477\": rpc error: code = NotFound desc = could not find container \"1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477\": container with ID starting with 1f7ba2599d9cb53f83daef618d23a997077d7ced3b2c653360550989ca159477 not found: ID does not exist"
May 27 20:34:28.358950 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.358921    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:34:28.360514 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:28.360501    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7qgkl"]
May 27 20:34:29.630340 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:34:29.630303    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82c0954-0051-430e-ba45-956ef3925e3a" path="/var/lib/kubelet/pods/a82c0954-0051-430e-ba45-956ef3925e3a/volumes"
May 27 20:35:33.889693 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.889596    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"]
May 27 20:35:33.890240 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.890150    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82c0954-0051-430e-ba45-956ef3925e3a" containerName="manager"
May 27 20:35:33.890240 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.890167    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82c0954-0051-430e-ba45-956ef3925e3a" containerName="manager"
May 27 20:35:33.890326 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.890251    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82c0954-0051-430e-ba45-956ef3925e3a" containerName="manager"
May 27 20:35:33.893611 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.893597    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:33.896404 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.896373    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qjqg7\""
May 27 20:35:33.903988 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.903967    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"]
May 27 20:35:33.965662 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.965618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qr4\" (UniqueName: \"kubernetes.io/projected/ff85f2c6-0d46-482e-bd00-b40335d74fc9-kube-api-access-l4qr4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:33.965777 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:33.965679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff85f2c6-0d46-482e-bd00-b40335d74fc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.066683 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.066660    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qr4\" (UniqueName: \"kubernetes.io/projected/ff85f2c6-0d46-482e-bd00-b40335d74fc9-kube-api-access-l4qr4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.066795 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.066696    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff85f2c6-0d46-482e-bd00-b40335d74fc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.067017 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.067001    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff85f2c6-0d46-482e-bd00-b40335d74fc9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.075746 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.075722    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qr4\" (UniqueName: \"kubernetes.io/projected/ff85f2c6-0d46-482e-bd00-b40335d74fc9-kube-api-access-l4qr4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xjnxz\" (UID: \"ff85f2c6-0d46-482e-bd00-b40335d74fc9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.203466 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.203415    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.342141 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.342114    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"]
May 27 20:35:34.344308 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:35:34.344282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff85f2c6_0d46_482e_bd00_b40335d74fc9.slice/crio-08262ced5bf0a385ee2d8d5752c893f5d37604494c8a3260874ecbf6baaf8d9a WatchSource:0}: Error finding container 08262ced5bf0a385ee2d8d5752c893f5d37604494c8a3260874ecbf6baaf8d9a: Status 404 returned error can't find the container with id 08262ced5bf0a385ee2d8d5752c893f5d37604494c8a3260874ecbf6baaf8d9a
May 27 20:35:34.346574 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.346554    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 20:35:34.555105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.555061    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz" event={"ID":"ff85f2c6-0d46-482e-bd00-b40335d74fc9","Type":"ContainerStarted","Data":"f8ea4013417166eeb7ab0870f5a96a3d0a9d7cf2140fab8aacc2e0f83be63dc9"}
May 27 20:35:34.555255 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.555117    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz" event={"ID":"ff85f2c6-0d46-482e-bd00-b40335d74fc9","Type":"ContainerStarted","Data":"08262ced5bf0a385ee2d8d5752c893f5d37604494c8a3260874ecbf6baaf8d9a"}
May 27 20:35:34.555255 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.555191    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:34.573050 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:34.573011    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz" podStartSLOduration=1.572999933 podStartE2EDuration="1.572999933s" podCreationTimestamp="2026-05-27 20:35:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:35:34.571888672 +0000 UTC m=+1527.563260522" watchObservedRunningTime="2026-05-27 20:35:34.572999933 +0000 UTC m=+1527.564371789"
May 27 20:35:45.560222 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:45.560194    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xjnxz"
May 27 20:35:53.704533 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:53.704502    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:35:58.830317 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:35:58.830277    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:36:23.631069 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:36:23.631037    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:36:31.288404 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:36:31.288369    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:36:40.410860 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:36:40.410826    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:36:50.685973 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:36:50.685939    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:36:59.792092 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:36:59.792012    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:10.101597 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:10.101551    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:18.795720 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:18.795690    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:29.803700 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:29.803666    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:37.789901 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:37.789868    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:48.394361 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:48.394325    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:37:57.491360 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:37:57.491299    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:38:31.397462 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:38:31.397388    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:13.292553 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:13.292508    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:22.894167 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:22.894131    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:30.395425 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:30.395381    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:39.091654 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:39.091625    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:47.898449 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:47.898412    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:39:57.893593 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:39:57.893496    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:07.200541 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:07.200506    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:13.997626 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:13.997577    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:24.091155 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:24.091119    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:32.006697 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:32.006657    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:40.698265 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:40.698236    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:40:50.686774 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:40:50.686742    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:09.300075 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:09.300031    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:16.599988 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:16.599946    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:25.506208 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:25.506171    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:34.492537 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:34.492461    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:51.195748 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:51.195717    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:41:59.899094 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:41:59.899054    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:08.307705 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:08.307671    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:16.801626 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:16.801577    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:25.551064 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:25.551033    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:33.729263 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:33.729233    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:43.408804 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:43.408773    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:42:56.632194 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:42:56.632163    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:06.349184 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:06.349155    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:19.433954 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:19.433917    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:28.405104 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:28.405065    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:36.512740 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:36.512702    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:45.405188 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:45.405149    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:43:53.202230 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:43:53.202199    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:44:09.492212 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:44:09.492181    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:44:17.956589 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:44:17.956558    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:44:26.817373 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:44:26.817305    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:44:34.701627 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:44:34.701577    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:44:59.000218 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:44:59.000182    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:45:11.000565 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:11.000530    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vwmzq"]
May 27 20:45:17.948821 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:17.948795    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59479dd8d-srv8p_864e264c-b3c8-49f7-aa7f-1130f95134a1/manager/0.log"
May 27 20:45:19.483502 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:19.483466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-646xs_c00bbf53-4956-4fc3-8b79-de4034d58b6f/manager/0.log"
May 27 20:45:19.588001 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:19.587967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-t4z8x_a9debb8e-f200-451e-9f9b-a2010318d5af/kuadrant-console-plugin/0.log"
May 27 20:45:19.699070 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:19.699044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n8mbd_902f6264-bcd2-4aff-a3d2-8514a0348b84/registry-server/0.log"
May 27 20:45:19.819070 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:19.819043    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xjnxz_ff85f2c6-0d46-482e-bd00-b40335d74fc9/manager/0.log"
May 27 20:45:19.927818 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:19.927795    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vwmzq_1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe/limitador/0.log"
May 27 20:45:20.387077 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:20.387052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g_188d4c89-ac5c-4bb2-ab40-8d0a02f74a05/istio-proxy/0.log"
May 27 20:45:20.825480 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:20.825454    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fj5dr_6558f3d4-bd46-49db-85d8-48b28ef466b0/istio-proxy/0.log"
May 27 20:45:21.605505 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:21.605474    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-wjhvj_8fbf9484-9959-439c-9eaa-5808d0215e36/main/0.log"
May 27 20:45:21.612762 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:21.612732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-wjhvj_8fbf9484-9959-439c-9eaa-5808d0215e36/storage-initializer/0.log"
May 27 20:45:21.714761 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:21.714732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4_6db14c7b-d322-45c2-adba-910537706f5b/storage-initializer/0.log"
May 27 20:45:21.721511 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:21.721489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb6rs4_6db14c7b-d322-45c2-adba-910537706f5b/main/0.log"
May 27 20:45:29.095120 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:29.095086    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bw8lp_25f2bbff-8b69-442e-8d09-66e0ddc036db/global-pull-secret-syncer/0.log"
May 27 20:45:29.227335 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:29.227303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cx825_6688a634-a547-4c54-879b-1b3bdf967ab9/konnectivity-agent/0.log"
May 27 20:45:29.280879 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:29.280852    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-19.ec2.internal_3545e8d242b47d9e14444fc9a6b21b33/haproxy/0.log"
May 27 20:45:33.151272 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:33.151242    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-646xs_c00bbf53-4956-4fc3-8b79-de4034d58b6f/manager/0.log"
May 27 20:45:33.178769 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:33.178745    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-t4z8x_a9debb8e-f200-451e-9f9b-a2010318d5af/kuadrant-console-plugin/0.log"
May 27 20:45:33.229373 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:33.229334    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n8mbd_902f6264-bcd2-4aff-a3d2-8514a0348b84/registry-server/0.log"
May 27 20:45:33.288378 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:33.288355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xjnxz_ff85f2c6-0d46-482e-bd00-b40335d74fc9/manager/0.log"
May 27 20:45:33.320740 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:33.320719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vwmzq_1fe006a1-66e3-49a6-b6ca-c0f80e7f62fe/limitador/0.log"
May 27 20:45:34.625874 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.625842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/alertmanager/0.log"
May 27 20:45:34.649487 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.649461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/config-reloader/0.log"
May 27 20:45:34.669451 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.669430    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/kube-rbac-proxy-web/0.log"
May 27 20:45:34.691686 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.691665    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/kube-rbac-proxy/0.log"
May 27 20:45:34.713454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.713436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/kube-rbac-proxy-metric/0.log"
May 27 20:45:34.733424 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.733404    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/prom-label-proxy/0.log"
May 27 20:45:34.763273 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.763252    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_278f60c7-9f18-440b-907d-f9dc61e5f23b/init-config-reloader/0.log"
May 27 20:45:34.914117 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.914045    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6795f97778-l7lgt_fbfaf5d8-2a31-4964-bd7c-2b2cea773e6c/metrics-server/0.log"
May 27 20:45:34.944467 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:34.944443    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-sbw6w_0120e3c5-e241-48a9-9ae3-31bf66d86bc9/monitoring-plugin/0.log"
May 27 20:45:35.225395 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.225333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ds4jd_ea4e64bf-c5a7-449a-a8c9-f10aec9918e1/node-exporter/0.log"
May 27 20:45:35.270639 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.270618    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ds4jd_ea4e64bf-c5a7-449a-a8c9-f10aec9918e1/kube-rbac-proxy/0.log"
May 27 20:45:35.316805 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.316782    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ds4jd_ea4e64bf-c5a7-449a-a8c9-f10aec9918e1/init-textfile/0.log"
May 27 20:45:35.724154 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.724128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-xfpk2_ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f/prometheus-operator/0.log"
May 27 20:45:35.749526 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.749481    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-xfpk2_ab6d0d43-cd5e-45b2-a0c9-4ea5fbdaba2f/kube-rbac-proxy/0.log"
May 27 20:45:35.812808 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.812789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8577b644c9-55tjg_9209fc6b-5d3b-49fe-97e0-f8df511cfadb/telemeter-client/0.log"
May 27 20:45:35.839105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.839085    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8577b644c9-55tjg_9209fc6b-5d3b-49fe-97e0-f8df511cfadb/reload/0.log"
May 27 20:45:35.867528 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.867509    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8577b644c9-55tjg_9209fc6b-5d3b-49fe-97e0-f8df511cfadb/kube-rbac-proxy/0.log"
May 27 20:45:35.902958 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.902943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/thanos-query/0.log"
May 27 20:45:35.942127 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.942110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/kube-rbac-proxy-web/0.log"
May 27 20:45:35.995054 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:35.994971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/kube-rbac-proxy/0.log"
May 27 20:45:36.027355 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:36.027323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/prom-label-proxy/0.log"
May 27 20:45:36.054801 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:36.054783    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/kube-rbac-proxy-rules/0.log"
May 27 20:45:36.077454 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:36.077437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c59b69d8-8gkfs_0370d9b8-3da3-4501-8237-4b60b9363b4a/kube-rbac-proxy-metrics/0.log"
May 27 20:45:37.130668 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.130637    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-j775g_98651f5a-36f8-4047-8e1e-2c7e3ab71c5d/networking-console-plugin/0.log"
May 27 20:45:37.520818 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.520787    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"]
May 27 20:45:37.524635 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.524617    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.527104 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.527081    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vmh6\"/\"kube-root-ca.crt\""
May 27 20:45:37.528233 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.528209    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6vmh6\"/\"default-dockercfg-kc4bs\""
May 27 20:45:37.528332 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.528209    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vmh6\"/\"openshift-service-ca.crt\""
May 27 20:45:37.535133 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.535113    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"]
May 27 20:45:37.609806 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.609781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr2k9\" (UniqueName: \"kubernetes.io/projected/89a3f4ab-fb70-4258-ad58-d277c3befb46-kube-api-access-kr2k9\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.609947 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.609927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-lib-modules\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.610035 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.609960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-podres\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.610035 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.609990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-proc\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.610035 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.610028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-sys\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711031 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711010    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-lib-modules\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711037    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-podres\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711056    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-proc\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711081    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-sys\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711123 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711119    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr2k9\" (UniqueName: \"kubernetes.io/projected/89a3f4ab-fb70-4258-ad58-d277c3befb46-kube-api-access-kr2k9\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711278 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711159    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-proc\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711278 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-sys\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711278 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-podres\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.711278 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.711181    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89a3f4ab-fb70-4258-ad58-d277c3befb46-lib-modules\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.722105 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.722074    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr2k9\" (UniqueName: \"kubernetes.io/projected/89a3f4ab-fb70-4258-ad58-d277c3befb46-kube-api-access-kr2k9\") pod \"perf-node-gather-daemonset-5dvp7\" (UID: \"89a3f4ab-fb70-4258-ad58-d277c3befb46\") " pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.834267 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.834205    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:37.960679 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.960654    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"]
May 27 20:45:37.963719 ip-10-0-129-19 kubenswrapper[2565]: W0527 20:45:37.963689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89a3f4ab_fb70_4258_ad58_d277c3befb46.slice/crio-41ae862186982019603ff1306ca92f044a4aaf01ecda64b8dc6f7eab6baa4df2 WatchSource:0}: Error finding container 41ae862186982019603ff1306ca92f044a4aaf01ecda64b8dc6f7eab6baa4df2: Status 404 returned error can't find the container with id 41ae862186982019603ff1306ca92f044a4aaf01ecda64b8dc6f7eab6baa4df2
May 27 20:45:37.965367 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:37.965321    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 20:45:38.256925 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:38.256901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-bnqvt_b4c7b7aa-ceb9-4aca-a853-d2ecfa3f3454/download-server/0.log"
May 27 20:45:38.662510 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:38.662427    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7" event={"ID":"89a3f4ab-fb70-4258-ad58-d277c3befb46","Type":"ContainerStarted","Data":"11132dfdd2bc7fbb8a275aec5856c694e1294778429401c0690be564abdddadc"}
May 27 20:45:38.662510 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:38.662464    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7" event={"ID":"89a3f4ab-fb70-4258-ad58-d277c3befb46","Type":"ContainerStarted","Data":"41ae862186982019603ff1306ca92f044a4aaf01ecda64b8dc6f7eab6baa4df2"}
May 27 20:45:38.662764 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:38.662552    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:38.680189 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:38.680145    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7" podStartSLOduration=1.680131645 podStartE2EDuration="1.680131645s" podCreationTimestamp="2026-05-27 20:45:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 20:45:38.67886262 +0000 UTC m=+2131.670234474" watchObservedRunningTime="2026-05-27 20:45:38.680131645 +0000 UTC m=+2131.671503500"
May 27 20:45:39.625488 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:39.625452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-745k4_b709e35c-f5ae-4f15-9508-53bc681eea79/dns/0.log"
May 27 20:45:39.670255 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:39.670221    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-745k4_b709e35c-f5ae-4f15-9508-53bc681eea79/kube-rbac-proxy/0.log"
May 27 20:45:39.883671 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:39.883598    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5zqm_b4a3cc56-1f86-42a9-bd25-ca35760c5f27/dns-node-resolver/0.log"
May 27 20:45:40.371550 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:40.371522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgcm7_c37a2e35-1576-4b24-bb4f-3690318cefd9/node-ca/0.log"
May 27 20:45:41.195509 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:41.195477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bt8p9g_188d4c89-ac5c-4bb2-ab40-8d0a02f74a05/istio-proxy/0.log"
May 27 20:45:41.458853 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:41.458781    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-fj5dr_6558f3d4-bd46-49db-85d8-48b28ef466b0/istio-proxy/0.log"
May 27 20:45:42.069083 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:42.069055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d29x4_19d8c15c-e30c-4392-b34c-2e6269398ad4/serve-healthcheck-canary/0.log"
May 27 20:45:42.635719 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:42.635691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmmcp_a4f82322-762e-470c-b662-237246658a09/kube-rbac-proxy/0.log"
May 27 20:45:42.657087 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:42.657068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmmcp_a4f82322-762e-470c-b662-237246658a09/exporter/0.log"
May 27 20:45:42.678618 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:42.678594    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jmmcp_a4f82322-762e-470c-b662-237246658a09/extractor/0.log"
May 27 20:45:44.676931 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:44.676905    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6vmh6/perf-node-gather-daemonset-5dvp7"
May 27 20:45:45.077961 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:45.077927    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59479dd8d-srv8p_864e264c-b3c8-49f7-aa7f-1130f95134a1/manager/0.log"
May 27 20:45:46.351148 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:46.351119    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b4cbbc776-nsp68_36cd6214-eb6e-4cee-b6ed-57e68a920167/manager/0.log"
May 27 20:45:52.232389 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.232338    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/kube-multus-additional-cni-plugins/0.log"
May 27 20:45:52.254485 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.254453    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/egress-router-binary-copy/0.log"
May 27 20:45:52.275698 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.275676    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/cni-plugins/0.log"
May 27 20:45:52.297558 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.297538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/bond-cni-plugin/0.log"
May 27 20:45:52.320621 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.320597    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/routeoverride-cni/0.log"
May 27 20:45:52.342144 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.342124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/whereabouts-cni-bincopy/0.log"
May 27 20:45:52.363052 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.363023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r75cn_a0e7422f-c7ed-4abd-9ad7-055fcc824cfb/whereabouts-cni/0.log"
May 27 20:45:52.581126 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.581105    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qnxck_7dc2a48e-3ae5-4529-abdb-17b6a6f3ffbe/kube-multus/0.log"
May 27 20:45:52.601200 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.601173    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89b9c_e2ca65ad-7d95-411a-b130-837842fb0836/network-metrics-daemon/0.log"
May 27 20:45:52.622190 ip-10-0-129-19 kubenswrapper[2565]: I0527 20:45:52.622172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-89b9c_e2ca65ad-7d95-411a-b130-837842fb0836/kube-rbac-proxy/0.log"