Jun 03 15:48:58.158363 ip-10-0-135-102 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 15:48:58.598895 ip-10-0-135-102 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 15:48:58.598895 ip-10-0-135-102 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 15:48:58.598895 ip-10-0-135-102 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 15:48:58.598895 ip-10-0-135-102 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 15:48:58.598895 ip-10-0-135-102 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 15:48:58.601082 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.600957    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606855    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606880    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606887    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606891    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606894    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 15:48:58.606887 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606899    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606903    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606906    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606908    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606911    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606914    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606916    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606919    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606921    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606924    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606926    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606929    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606931    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606934    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606936    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606940    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606951    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606953    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606956    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606959    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 15:48:58.607155 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606961    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606964    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606966    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606969    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606989    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606994    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606997    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.606999    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607002    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607005    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607007    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607010    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607012    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607014    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607018    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607021    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607024    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607026    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607029    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607032    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 15:48:58.607636 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607034    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607037    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607040    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607043    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607045    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607049    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607052    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607054    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607056    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607059    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607062    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607064    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607066    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607069    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607072    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607075    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607077    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607080    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607082    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607085    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 15:48:58.608190 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607088    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607090    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607093    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607095    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607097    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607100    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607103    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607106    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607108    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607110    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607113    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607115    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607118    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607121    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607124    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607127    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607130    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607133    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607136    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607140    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 15:48:58.608677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607144    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607561    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607566    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607569    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607571    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607574    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607577    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607580    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607582    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607585    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607587    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607590    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607593    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607595    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607598    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607601    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607603    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607605    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607608    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607611    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 15:48:58.609186 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607614    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607616    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607619    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607621    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607624    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607627    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607630    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607632    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607635    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607637    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607640    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607643    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607646    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607648    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607651    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607654    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607656    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607658    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607661    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607663    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 15:48:58.609677 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607665    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607668    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607670    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607673    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607675    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607678    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607680    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607683    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607685    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607687    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607691    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607693    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607696    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607698    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607701    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607703    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607706    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607716    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607719    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607722    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 15:48:58.610197 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607725    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607729    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607733    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607735    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607738    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607741    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607743    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607746    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607748    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607751    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607753    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607756    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607758    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607760    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607763    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607766    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607770    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607773    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607776    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607778    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 15:48:58.610702 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607781    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607784    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607786    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607789    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607792    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607794    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.607796    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608510    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608522    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608530    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608535    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608540    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608544    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608548    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608553    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608557    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608560    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608564    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608567    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608570    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608573    2562 flags.go:64] FLAG: --cgroup-root=""
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608576    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 15:48:58.611256 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608578    2562 flags.go:64] FLAG: --client-ca-file=""
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608581    2562 flags.go:64] FLAG: --cloud-config=""
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608584    2562 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608586    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608590    2562 flags.go:64] FLAG: --cluster-domain=""
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608594    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608597    2562 flags.go:64] FLAG: --config-dir=""
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608600    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608603    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608607    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608610    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608612    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608616    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608619    2562 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608622    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608626    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608629    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608632    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608636    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608639    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608642    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608645    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608649    2562 flags.go:64] FLAG: --enable-server="true"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608652    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608656    2562 flags.go:64] FLAG: --event-burst="100"
Jun 03 15:48:58.611792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608659    2562 flags.go:64] FLAG: --event-qps="50"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608662    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608665    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608668    2562 flags.go:64] FLAG: --eviction-hard=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608672    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608675    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608678    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608681    2562 flags.go:64] FLAG: --eviction-soft=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608684    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608687    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608690    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608693    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608696    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608699    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608702    2562 flags.go:64] FLAG: --feature-gates=""
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608706    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608709    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608712    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608715    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608718    2562 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608721    2562 flags.go:64] FLAG: --help="false"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608724    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608727    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608730    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 15:48:58.612429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608733    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608736    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608739    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608742    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608745    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608747    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608754    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608758    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608761    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608764    2562 flags.go:64] FLAG: --kube-reserved=""
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608766    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608769    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608772    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608775    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608778    2562 flags.go:64] FLAG: --lock-file=""
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608781    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608784    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608787    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608792    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608795    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608798    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608800    2562 flags.go:64] FLAG: --logging-format="text"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608803    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608807    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 15:48:58.613030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608810    2562 flags.go:64] FLAG: --manifest-url=""
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608813    2562 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608822    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608825    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608829    2562 flags.go:64] FLAG: --max-pods="110"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608833    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608836    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608839    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608842    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608845    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608848    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608851    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608858    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608861    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608864    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608868    2562 flags.go:64] FLAG: --pod-cidr=""
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608871    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608877    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608880    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608883    2562 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608886    2562 flags.go:64] FLAG: --port="10250"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608889    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608892    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06e769ffed9e17c01"
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608895    2562 flags.go:64] FLAG: --qos-reserved=""
Jun 03 15:48:58.613603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608897    2562 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608900    2562 flags.go:64] FLAG: --register-node="true"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608903    2562 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608906    2562 flags.go:64] FLAG: --register-with-taints=""
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608910    2562 flags.go:64] FLAG: --registry-burst="10"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608913    2562 flags.go:64] FLAG: --registry-qps="5"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608915    2562 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608918    2562 flags.go:64] FLAG: --reserved-memory=""
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608922    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608925    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608931    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608933    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608936    2562 flags.go:64] FLAG: --runonce="false"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608939    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608942    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608945    2562 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608948    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608951    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608954    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608957    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608959    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608962    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608965    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608967    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608971    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608990    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 15:48:58.614297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608993    2562 flags.go:64] FLAG: --system-cgroups=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.608996    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609002    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609007    2562 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609009    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609013    2562 flags.go:64] FLAG: --tls-min-version=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609016    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609018    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609021    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609024    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609027    2562 flags.go:64] FLAG: --v="2"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609032    2562 flags.go:64] FLAG: --version="false"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609036    2562 flags.go:64] FLAG: --vmodule=""
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609040    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609044    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609143    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609150    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609153    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609156    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609159    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609162    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609164    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 15:48:58.614967 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609167    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609169    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609172    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609174    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609177    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609179    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609182    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609185    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609188    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609191    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609194    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609197    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609199    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609203    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609206    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609209    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609212    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609214    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609217    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609219    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 15:48:58.615518 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609222    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609224    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609226    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609229    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609231    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609234    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609237    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609240    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609242    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609245    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609247    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609250    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609252    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609254    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609257    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609259    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609262    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609265    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609267    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 15:48:58.616049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609269    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609272    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609275    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609278    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609281    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609284    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609290    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609293    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609295    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609298    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609300    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609303    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609305    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609308    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609310    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609312    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609315    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609317    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609320    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 15:48:58.616528 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609324    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609326    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609329    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609332    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609334    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609337    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609339    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609341    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609344    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609346    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609349    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609352    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609354    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609357    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609360    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609362    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609364    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609367    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609370    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609374    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 15:48:58.617025 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.609376    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 15:48:58.617529 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.609382    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 15:48:58.617927 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.617900    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 15:48:58.617967 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.617929    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 15:48:58.618010 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.617995    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 15:48:58.618010 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618002    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 15:48:58.618010 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618006    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 15:48:58.618010 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618009    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618012    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618016    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618019    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618021    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618024    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618027    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618029    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618032    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618034    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618036    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618039    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618041    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618043    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618046    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618049    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618052    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618055    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618057    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618060    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 15:48:58.618116 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618063    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618065    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618069    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618071    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618074    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618077    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618080    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618083    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618086    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618088    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618091    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618093    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618095    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618098    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618101    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618104    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618106    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618109    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618112    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 15:48:58.618648 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618116    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618120    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618123    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618126    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618129    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618132    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618134    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618137    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618139    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618141    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618144    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618147    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618150    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618152    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618155    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618157    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618161    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618163    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618167    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618169    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 15:48:58.619218 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618171    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618174    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618176    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618179    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618181    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618184    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618187    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618190    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618192    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618195    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618197    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618200    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618202    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618204    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618209    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618214    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618216    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618219    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618222    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 15:48:58.619709 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618225    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618228    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618231    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618233    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618236    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.618241    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618349    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618354    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618357    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618360    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618363    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618367    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618370    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618375    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618378    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 15:48:58.620189 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618381    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618385    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618387    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618390    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618392    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618395    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618398    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618400    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618403    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618405    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618408    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618411    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618413    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618416    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618418    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618421    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618424    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618426    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618429    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 15:48:58.620572 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618431    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618434    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618437    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618439    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618442    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618445    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618447    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618449    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618452    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618456    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618458    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618461    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618463    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618466    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618468    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618471    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618473    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618476    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618478    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618481    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 15:48:58.621043 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618484    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618486    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618489    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618491    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618494    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618498    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618500    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618502    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618505    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618507    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618510    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618512    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618515    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618517    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618519    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618522    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618525    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618527    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618530    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 15:48:58.621526 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618532    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618536    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618539    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618543    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618546    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618548    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618551    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618554    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618556    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618559    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618562    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618564    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618567    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618569    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618572    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618574    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618577    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618579    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 15:48:58.622022 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:58.618581    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 15:48:58.622463 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.618587    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 15:48:58.622463 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.619245    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 15:48:58.622599 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.622582    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 15:48:58.623922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.623909    2562 server.go:1019] "Starting client certificate rotation"
Jun 03 15:48:58.624036 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.624016    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 15:48:58.624066 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.624057    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 15:48:58.648088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.648063    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 15:48:58.649725 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.649699    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 15:48:58.668861 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.668829    2562 log.go:25] "Validated CRI v1 runtime API"
Jun 03 15:48:58.675779 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.675757    2562 log.go:25] "Validated CRI v1 image API"
Jun 03 15:48:58.678333 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.678309    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 15:48:58.682834 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.682804    2562 fs.go:135] Filesystem UUIDs: map[47563bbc-ec30-4afb-b56e-605577a3e67a:/dev/nvme0n1p4 59ef4747-592f-476f-8e80-f3ebebab1890:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jun 03 15:48:58.682834 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.682831    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 15:48:58.684498 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.684325    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 15:48:58.687432 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.687318    2562 manager.go:217] Machine: {Timestamp:2026-06-03 15:48:58.686779425 +0000 UTC m=+0.405224530 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096044 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d45be4613cacee0ceb48b897a49bf SystemUUID:ec2d45be-4613-cace-e0ce-b48b897a49bf BootID:effcae5e-ebea-42f0-b614-a2de5d3d7c65 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:2e:1a:bd:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:2e:1a:bd:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:6b:27:18:90:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 15:48:58.687947 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.687935    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 15:48:58.688075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.688061    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 15:48:58.689798 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.689770    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 15:48:58.689945 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.689801    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 15:48:58.690016 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.689957    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 15:48:58.690016 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.689966    2562 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 15:48:58.690016 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.689988    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 15:48:58.690558 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.690546    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 15:48:58.692035 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.692020    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 15:48:58.692170 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.692159    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 15:48:58.694387 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.694374    2562 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 15:48:58.694426 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.694391    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 15:48:58.694426 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.694404    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 15:48:58.694426 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.694414    2562 kubelet.go:397] "Adding apiserver pod source"
Jun 03 15:48:58.694426 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.694423    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 15:48:58.695439 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.695426    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 15:48:58.695487 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.695447    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 15:48:58.698183 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.698165    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 15:48:58.700020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.700005    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 15:48:58.702939 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702924    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702946    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702954    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702959    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702986    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.702996    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703005    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703010    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703018    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703024    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 15:48:58.703028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703033    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 15:48:58.703398 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703039    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 15:48:58.703835 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703824    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 15:48:58.703864 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.703836    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 15:48:58.707499 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.707481    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 15:48:58.707581 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.707517    2562 server.go:1295] "Started kubelet"
Jun 03 15:48:58.708206 ip-10-0-135-102 systemd[1]: Started Kubernetes Kubelet.
Jun 03 15:48:58.710189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.710013    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 15:48:58.710189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.710092    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 15:48:58.710189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.710026    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 15:48:58.710352 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.710307    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 15:48:58.710394 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.710356    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 15:48:58.710494 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.710476    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 15:48:58.711083 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.711064    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 15:48:58.711905 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.711889    2562 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 15:48:58.718865 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.718836    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 15:48:58.718960 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.718077    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-102.ec2.internal.18b59ce5d9a0298c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-102.ec2.internal,UID:ip-10-0-135-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-102.ec2.internal,},FirstTimestamp:2026-06-03 15:48:58.707495308 +0000 UTC m=+0.425940412,LastTimestamp:2026-06-03 15:48:58.707495308 +0000 UTC m=+0.425940412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-102.ec2.internal,}"
Jun 03 15:48:58.719089 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.718952    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 15:48:58.719211 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719188    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 15:48:58.719362 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719344    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 15:48:58.719362 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719361    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 15:48:58.719479 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719464    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 15:48:58.719538 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719525    2562 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 15:48:58.719538 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.719537    2562 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 15:48:58.719960 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.719939    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:58.720309 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720289    2562 factory.go:153] Registering CRI-O factory
Jun 03 15:48:58.720392 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720313    2562 factory.go:223] Registration of the crio container factory successfully
Jun 03 15:48:58.720392 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720366    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 15:48:58.720392 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720373    2562 factory.go:55] Registering systemd factory
Jun 03 15:48:58.720392 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720379    2562 factory.go:223] Registration of the systemd container factory successfully
Jun 03 15:48:58.720571 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720396    2562 factory.go:103] Registering Raw factory
Jun 03 15:48:58.720571 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720415    2562 manager.go:1196] Started watching for new ooms in manager
Jun 03 15:48:58.720848 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.720833    2562 manager.go:319] Starting recovery of all containers
Jun 03 15:48:58.724901 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.724863    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 15:48:58.725054 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.725003    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 15:48:58.729751 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.729731    2562 manager.go:324] Recovery completed
Jun 03 15:48:58.731185 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.731150    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jun 03 15:48:58.734706 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.734691    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.737557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.737538    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.737644 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.737569    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.737644 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.737580    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.738190 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.738172    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 15:48:58.738190 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.738189    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 15:48:58.738279 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.738207    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 15:48:58.738861 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.738845    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4x7k"
Jun 03 15:48:58.740230 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.740158    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-102.ec2.internal.18b59ce5db6ad82d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-102.ec2.internal,UID:ip-10-0-135-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-102.ec2.internal,},FirstTimestamp:2026-06-03 15:48:58.737555501 +0000 UTC m=+0.456000606,LastTimestamp:2026-06-03 15:48:58.737555501 +0000 UTC m=+0.456000606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-102.ec2.internal,}"
Jun 03 15:48:58.740477 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.740464    2562 policy_none.go:49] "None policy: Start"
Jun 03 15:48:58.740521 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.740483    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 15:48:58.740521 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.740494    2562 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 15:48:58.749943 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.749916    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4x7k"
Jun 03 15:48:58.751788 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.751663    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-102.ec2.internal.18b59ce5db6b1eb4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-102.ec2.internal,UID:ip-10-0-135-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-102.ec2.internal,},FirstTimestamp:2026-06-03 15:48:58.737573556 +0000 UTC m=+0.456018659,LastTimestamp:2026-06-03 15:48:58.737573556 +0000 UTC m=+0.456018659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-102.ec2.internal,}"
Jun 03 15:48:58.782710 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.782688    2562 manager.go:341] "Starting Device Plugin manager"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.782735    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.782745    2562 server.go:85] "Starting device plugin registration server"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.783054    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.783069    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.783186    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.783290    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.783298    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.783868    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 15:48:58.786020 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.783905    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:58.817891 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.817847    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 15:48:58.819461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.819444    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 15:48:58.819547 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.819477    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 15:48:58.819547 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.819498    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 15:48:58.819547 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.819507    2562 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 15:48:58.819664 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.819550    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 15:48:58.823744 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.823723    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:48:58.884036 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.883938    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.885124 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.885105    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.885215 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.885144    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.885215 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.885156    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.885215 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.885181    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.894188 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.894167    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.894245 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.894196    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-102.ec2.internal\": node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:58.910714 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.910691    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:58.919726 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.919705    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"]
Jun 03 15:48:58.919794 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.919781    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.920765 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.920748    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.920837 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.920779    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.920837 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.920799    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.921752 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.921738    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.921930 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.921907    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.922057 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.921938    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.922522 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922508    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.922522 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922516    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.922639 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922537    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.922639 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922543    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.922639 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922551    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.922639 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.922557    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.923578 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.923561    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.923680 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.923587    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 15:48:58.924327 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.924304    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 15:48:58.924442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.924332    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 15:48:58.924442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:58.924346    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeHasSufficientPID"
Jun 03 15:48:58.956909 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.956882    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-102.ec2.internal\" not found" node="ip-10-0-135-102.ec2.internal"
Jun 03 15:48:58.961339 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:58.961321    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-102.ec2.internal\" not found" node="ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.011083 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.011052    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.111510 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.111470    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.120816 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.120790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.120888 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.120823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/141341a8c185dbd90d002b2037e0f25d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-102.ec2.internal\" (UID: \"141341a8c185dbd90d002b2037e0f25d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.120888 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.120842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.212377 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.212279    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.221586 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221557    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/141341a8c185dbd90d002b2037e0f25d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-102.ec2.internal\" (UID: \"141341a8c185dbd90d002b2037e0f25d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.221653 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221591    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.221653 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221610    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.221735 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.221735 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221673    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/141341a8c185dbd90d002b2037e0f25d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-102.ec2.internal\" (UID: \"141341a8c185dbd90d002b2037e0f25d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.221804 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.221733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75e14fdc012467c7bfae7c515b816e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal\" (UID: \"75e14fdc012467c7bfae7c515b816e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.259742 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.259714    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.265331 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.265309    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.313322 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.313283    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.413808 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.413775    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.514366 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.514274    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.603107 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.603076    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:48:59.614707 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.614660    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-102.ec2.internal\" not found"
Jun 03 15:48:59.623986 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.623952    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 15:48:59.624148 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.624130    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 15:48:59.624210 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.624162    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 15:48:59.635035 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.634999    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:48:59.695261 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.695233    2562 apiserver.go:52] "Watching apiserver"
Jun 03 15:48:59.703130 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.703099    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 15:48:59.705485 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.705454    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-jlgn5","kube-system/konnectivity-agent-gsw87","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v","openshift-dns/node-resolver-r5p74","openshift-multus/multus-additional-cni-plugins-72gkk","openshift-multus/multus-sl2wk","openshift-multus/network-metrics-daemon-p8n47","openshift-network-diagnostics/network-check-target-hvdxf","openshift-network-operator/iptables-alerter-b7vg6","openshift-cluster-node-tuning-operator/tuned-jphcf","openshift-image-registry/node-ca-g5f5h"]
Jun 03 15:48:59.707369 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.707349    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.708304 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.708276    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.709569 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.709551    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.710910 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.710890    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.711950 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.711929    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 15:48:59.712063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.711961    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rf6qh\""
Jun 03 15:48:59.713676 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.712567    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 15:48:59.713676 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.712671    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.713676 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.713410    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 15:48:59.713676 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.713506    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714792    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714836    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714884    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714898    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714898    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714933    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 15:48:59.715079 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.714942    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715111    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715163    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h2nwq\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715229    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f72f9\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715303    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715362    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g8qkb\""
Jun 03 15:48:59.715428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715424    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 15:48:59.715751 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.715733    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 15:48:59.716754 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.716736    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.716836 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.716823    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.716906 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.716885    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:48:59.718193 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.718175    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.718316 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.718301    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:48:59.718379 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.718361    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:48:59.718920 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.718906    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 15:48:59.720603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.720547    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.720714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.720667    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.721031 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.720784    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfxbg\""
Jun 03 15:48:59.721031 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.720845    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 15:48:59.721031 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.720948    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.721850 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.721819    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.721929 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.721901    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.722148 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.721905    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.723301 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.723278    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 15:48:59.723398 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.723305    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9g5tn\""
Jun 03 15:48:59.723398 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.723353    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 15:48:59.724546 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cnibin\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.724617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-etc-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.724617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.724617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-system-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.724713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.724713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzw8f\" (UniqueName: \"kubernetes.io/projected/5eac3248-977d-4568-baa6-b27e5ca8f74f-kube-api-access-mzw8f\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.724713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.724713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw59q\" (UniqueName: \"kubernetes.io/projected/71e9a415-2331-4735-af63-73a38722ad39-kube-api-access-hw59q\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.724713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2rz\" (UniqueName: \"kubernetes.io/projected/2c0300be-0c52-4fcf-a35f-eb646dafd23e-kube-api-access-7p2rz\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xnd\" (UniqueName: \"kubernetes.io/projected/4a58d08d-e807-419b-b856-e5c1292b7c51-kube-api-access-24xnd\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-os-release\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-sys-fs\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a58d08d-e807-419b-b856-e5c1292b7c51-host-slash\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnks\" (UniqueName: \"kubernetes.io/projected/a74849aa-ac32-4d0f-b356-0e2346d8afad-kube-api-access-xbnks\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-netns\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-log-socket\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.724922 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-netd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkl9c\" (UniqueName: \"kubernetes.io/projected/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-kube-api-access-kkl9c\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.724967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74849aa-ac32-4d0f-b356-0e2346d8afad-host\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74849aa-ac32-4d0f-b356-0e2346d8afad-serviceca\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-kubelet\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-script-lib\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-hostroot\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725212    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwmt\" (UniqueName: \"kubernetes.io/projected/311562ad-9379-4db5-9c0e-90fdef2313cf-kube-api-access-gtwmt\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/141272c3-b793-4f3d-9ca7-ac87ae82bc00-konnectivity-ca\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-cni-binary-copy\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725314    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qd2k\""
Jun 03 15:48:59.725356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-multus-daemon-config\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-systemd-units\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88976586-c663-4f59-853c-7003507980b4-ovn-node-metrics-cert\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-registration-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725481    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-ovn\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311562ad-9379-4db5-9c0e-90fdef2313cf-hosts-file\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-node-log\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-cnibin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-socket-dir-parent\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725628    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-bin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-conf-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-etc-kubernetes\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a58d08d-e807-419b-b856-e5c1292b7c51-iptables-alerter-script\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-bin\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725783    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:48:59.725957 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-multus\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-env-overrides\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-os-release\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311562ad-9379-4db5-9c0e-90fdef2313cf-tmp-dir\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/141272c3-b793-4f3d-9ca7-ac87ae82bc00-agent-certs\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-system-cni-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.725969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-device-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726073    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-config\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-k8s-cni-cncf-io\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-multus-certs\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-systemd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq84l\" (UniqueName: \"kubernetes.io/projected/88976586-c663-4f59-853c-7003507980b4-kube-api-access-xq84l\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-netns\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-socket-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.726580 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-kubelet\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-slash\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-var-lib-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726428    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726453    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpwz4\""
Jun 03 15:48:59.727088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.726528    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d5tq9\""
Jun 03 15:48:59.737377 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.737353    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal"]
Jun 03 15:48:59.751947 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.751913    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:43:58 +0000 UTC" deadline="2028-02-13 17:54:18.31676312 +0000 UTC"
Jun 03 15:48:59.751947 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.751940    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14882h5m18.56482463s"
Jun 03 15:48:59.753069 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.753048    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 15:48:59.753195 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.753133    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"
Jun 03 15:48:59.764393 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.764346    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 15:48:59.766690 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.766672    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bfd7g"
Jun 03 15:48:59.781372 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:59.781328    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141341a8c185dbd90d002b2037e0f25d.slice/crio-5a64ba86addaf8bb764f58d2e5ff37754a2eaa3de2d6c1e3a9bd3f733a47fbf8 WatchSource:0}: Error finding container 5a64ba86addaf8bb764f58d2e5ff37754a2eaa3de2d6c1e3a9bd3f733a47fbf8: Status 404 returned error can't find the container with id 5a64ba86addaf8bb764f58d2e5ff37754a2eaa3de2d6c1e3a9bd3f733a47fbf8
Jun 03 15:48:59.781626 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:48:59.781600    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e14fdc012467c7bfae7c515b816e0c.slice/crio-3a007e5072148c501b454b909910ccdc0f2a588ce8ca5202f0c32f5539bcd785 WatchSource:0}: Error finding container 3a007e5072148c501b454b909910ccdc0f2a588ce8ca5202f0c32f5539bcd785: Status 404 returned error can't find the container with id 3a007e5072148c501b454b909910ccdc0f2a588ce8ca5202f0c32f5539bcd785
Jun 03 15:48:59.787332 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.787307    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 15:48:59.792620 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.792599    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 15:48:59.793056 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.793033    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal"]
Jun 03 15:48:59.800623 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.800597    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bfd7g"
Jun 03 15:48:59.820533 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.820512    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 15:48:59.822727 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.822676    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal" event={"ID":"75e14fdc012467c7bfae7c515b816e0c","Type":"ContainerStarted","Data":"3a007e5072148c501b454b909910ccdc0f2a588ce8ca5202f0c32f5539bcd785"}
Jun 03 15:48:59.823781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.823753    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal" event={"ID":"141341a8c185dbd90d002b2037e0f25d","Type":"ContainerStarted","Data":"5a64ba86addaf8bb764f58d2e5ff37754a2eaa3de2d6c1e3a9bd3f733a47fbf8"}
Jun 03 15:48:59.826617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwmt\" (UniqueName: \"kubernetes.io/projected/311562ad-9379-4db5-9c0e-90fdef2313cf-kube-api-access-gtwmt\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.826678 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826628    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/141272c3-b793-4f3d-9ca7-ac87ae82bc00-konnectivity-ca\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.826678 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-cni-binary-copy\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.826743 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-multus-daemon-config\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.826743 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-kubernetes\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.826743 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826729    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-systemd-units\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.826847 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826753    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88976586-c663-4f59-853c-7003507980b4-ovn-node-metrics-cert\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.826847 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpg9z\" (UniqueName: \"kubernetes.io/projected/b20c3d02-0d81-4f56-b4bc-8bb201da511f-kube-api-access-hpg9z\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.826946 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826883    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-registration-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.826946 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-systemd-units\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-registration-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.827064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.826971    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-ovn\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysconfig\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.827064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-sys\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827087    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311562ad-9379-4db5-9c0e-90fdef2313cf-hosts-file\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-ovn\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827131    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-node-log\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827148    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311562ad-9379-4db5-9c0e-90fdef2313cf-hosts-file\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/141272c3-b793-4f3d-9ca7-ac87ae82bc00-konnectivity-ca\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-node-log\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827195    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-cnibin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827225    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-socket-dir-parent\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-cni-binary-copy\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-cnibin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827263    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-bin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827291    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-conf-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-socket-dir-parent\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827309    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-etc-kubernetes\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827319    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71e9a415-2331-4735-af63-73a38722ad39-multus-daemon-config\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-conf\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827264    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827358    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a58d08d-e807-419b-b856-e5c1292b7c51-iptables-alerter-script\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-bin\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827384    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-bin\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-conf-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-etc-kubernetes\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827411    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-bin\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827440    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-multus\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.827619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-cni-multus\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-tmp\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827545    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-env-overrides\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827570    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-os-release\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827594    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311562ad-9379-4db5-9c0e-90fdef2313cf-tmp-dir\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-os-release\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827714    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/141272c3-b793-4f3d-9ca7-ac87ae82bc00-agent-certs\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-tuned\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827760    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-system-cni-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827783    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-device-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827806    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827839    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-system-cni-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827844    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-config\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827891    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-k8s-cni-cncf-io\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311562ad-9379-4db5-9c0e-90fdef2313cf-tmp-dir\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.828462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827917    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-multus-certs\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827941    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-systemd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827966    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xq84l\" (UniqueName: \"kubernetes.io/projected/88976586-c663-4f59-853c-7003507980b4-kube-api-access-xq84l\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.827995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-env-overrides\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-device-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-netns\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828053    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-socket-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828084    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-systemd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828110    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-kubelet\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-run\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828146    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-var-lib-kubelet\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-socket-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828165    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-slash\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-k8s-cni-cncf-io\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829249 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828204    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-var-lib-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828209    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-slash\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828232    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-multus-certs\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828234    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cnibin\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-host-run-netns\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-var-lib-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-etc-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cnibin\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828296    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-config\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-etc-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828337    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-system-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828363    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-lib-modules\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828416    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzw8f\" (UniqueName: \"kubernetes.io/projected/5eac3248-977d-4568-baa6-b27e5ca8f74f-kube-api-access-mzw8f\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-system-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828445    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.829991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828471    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hw59q\" (UniqueName: \"kubernetes.io/projected/71e9a415-2331-4735-af63-73a38722ad39-kube-api-access-hw59q\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-var-lib-kubelet\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-multus-cni-dir\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828551    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828579    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2rz\" (UniqueName: \"kubernetes.io/projected/2c0300be-0c52-4fcf-a35f-eb646dafd23e-kube-api-access-7p2rz\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828604    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xnd\" (UniqueName: \"kubernetes.io/projected/4a58d08d-e807-419b-b856-e5c1292b7c51-kube-api-access-24xnd\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.828802    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-run-openvswitch\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828829    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-os-release\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-os-release\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.828945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:00.328883554 +0000 UTC m=+2.047328662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a58d08d-e807-419b-b856-e5c1292b7c51-iptables-alerter-script\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.828991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-host\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829029    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-sys-fs\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.830552 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829083    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-sys-fs\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829093    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a58d08d-e807-419b-b856-e5c1292b7c51-host-slash\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829121    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnks\" (UniqueName: \"kubernetes.io/projected/a74849aa-ac32-4d0f-b356-0e2346d8afad-kube-api-access-xbnks\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a58d08d-e807-419b-b856-e5c1292b7c51-host-slash\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829140    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-netns\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829179    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-log-socket\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829206    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-netd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-log-socket\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-modprobe-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829181    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-run-netns\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-cni-netd\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-systemd\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829358    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkl9c\" (UniqueName: \"kubernetes.io/projected/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-kube-api-access-kkl9c\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829389    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829414    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74849aa-ac32-4d0f-b356-0e2346d8afad-host\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.831049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829440    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74849aa-ac32-4d0f-b356-0e2346d8afad-serviceca\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5eac3248-977d-4568-baa6-b27e5ca8f74f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829467    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-kubelet\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a74849aa-ac32-4d0f-b356-0e2346d8afad-host\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829495    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-script-lib\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829533    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829605    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-hostroot\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71e9a415-2331-4735-af63-73a38722ad39-hostroot\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829854    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a74849aa-ac32-4d0f-b356-0e2346d8afad-serviceca\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.829900    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88976586-c663-4f59-853c-7003507980b4-host-kubelet\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.830067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88976586-c663-4f59-853c-7003507980b4-ovnkube-script-lib\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.830166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.830617    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88976586-c663-4f59-853c-7003507980b4-ovn-node-metrics-cert\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.831517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.830707    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/141272c3-b793-4f3d-9ca7-ac87ae82bc00-agent-certs\") pod \"konnectivity-agent-gsw87\" (UID: \"141272c3-b793-4f3d-9ca7-ac87ae82bc00\") " pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:48:59.837430 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.837348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwmt\" (UniqueName: \"kubernetes.io/projected/311562ad-9379-4db5-9c0e-90fdef2313cf-kube-api-access-gtwmt\") pod \"node-resolver-r5p74\" (UID: \"311562ad-9379-4db5-9c0e-90fdef2313cf\") " pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:48:59.838638 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.838617    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:48:59.838638 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.838637    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:48:59.838767 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.838647    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:48:59.838767 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:48:59.838695    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:00.33868134 +0000 UTC m=+2.057126457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:48:59.839068 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.839049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzw8f\" (UniqueName: \"kubernetes.io/projected/5eac3248-977d-4568-baa6-b27e5ca8f74f-kube-api-access-mzw8f\") pod \"aws-ebs-csi-driver-node-mld8v\" (UID: \"5eac3248-977d-4568-baa6-b27e5ca8f74f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:48:59.845013 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.844958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2rz\" (UniqueName: \"kubernetes.io/projected/2c0300be-0c52-4fcf-a35f-eb646dafd23e-kube-api-access-7p2rz\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:48:59.845110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.845032    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw59q\" (UniqueName: \"kubernetes.io/projected/71e9a415-2331-4735-af63-73a38722ad39-kube-api-access-hw59q\") pod \"multus-sl2wk\" (UID: \"71e9a415-2331-4735-af63-73a38722ad39\") " pod="openshift-multus/multus-sl2wk"
Jun 03 15:48:59.847497 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.847479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkl9c\" (UniqueName: \"kubernetes.io/projected/8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8-kube-api-access-kkl9c\") pod \"multus-additional-cni-plugins-72gkk\" (UID: \"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8\") " pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:48:59.852422 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.852400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnks\" (UniqueName: \"kubernetes.io/projected/a74849aa-ac32-4d0f-b356-0e2346d8afad-kube-api-access-xbnks\") pod \"node-ca-g5f5h\" (UID: \"a74849aa-ac32-4d0f-b356-0e2346d8afad\") " pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:48:59.855635 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.855615    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq84l\" (UniqueName: \"kubernetes.io/projected/88976586-c663-4f59-853c-7003507980b4-kube-api-access-xq84l\") pod \"ovnkube-node-jlgn5\" (UID: \"88976586-c663-4f59-853c-7003507980b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:48:59.858845 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.858824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xnd\" (UniqueName: \"kubernetes.io/projected/4a58d08d-e807-419b-b856-e5c1292b7c51-kube-api-access-24xnd\") pod \"iptables-alerter-b7vg6\" (UID: \"4a58d08d-e807-419b-b856-e5c1292b7c51\") " pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:48:59.930809 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930752    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-kubernetes\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.930809 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930804    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpg9z\" (UniqueName: \"kubernetes.io/projected/b20c3d02-0d81-4f56-b4bc-8bb201da511f-kube-api-access-hpg9z\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.930809 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930824    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysconfig\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930845    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-sys\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930862    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-conf\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930891    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-tmp\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930900    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-kubernetes\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930931    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysconfig\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930931    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-sys\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.930913    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-tuned\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931033    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-run\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-conf\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-lib-modules\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931085    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-run\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-var-lib-kubelet\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931141    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-host\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931168    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-modprobe-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-var-lib-kubelet\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931191    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-systemd\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.931225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-host\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.932110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931192    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-sysctl-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.932110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931230    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-systemd\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.932110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931257    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-modprobe-d\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.932110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.931336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20c3d02-0d81-4f56-b4bc-8bb201da511f-lib-modules\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.933428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.933401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-tmp\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.933523 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.933433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b20c3d02-0d81-4f56-b4bc-8bb201da511f-etc-tuned\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:48:59.941259 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:48:59.941234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpg9z\" (UniqueName: \"kubernetes.io/projected/b20c3d02-0d81-4f56-b4bc-8bb201da511f-kube-api-access-hpg9z\") pod \"tuned-jphcf\" (UID: \"b20c3d02-0d81-4f56-b4bc-8bb201da511f\") " pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:49:00.038503 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.038409    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:49:00.045377 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.045350    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141272c3_b793_4f3d_9ca7_ac87ae82bc00.slice/crio-3d1e32a50da3bb6c7b57e95ebff2fbbaf805942049d18eeb7a2702aa6298464e WatchSource:0}: Error finding container 3d1e32a50da3bb6c7b57e95ebff2fbbaf805942049d18eeb7a2702aa6298464e: Status 404 returned error can't find the container with id 3d1e32a50da3bb6c7b57e95ebff2fbbaf805942049d18eeb7a2702aa6298464e
Jun 03 15:49:00.052566 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.052541    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5f5h"
Jun 03 15:49:00.059033 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.059008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74849aa_ac32_4d0f_b356_0e2346d8afad.slice/crio-23546c6e4573154f7749731b692d2117576de0f0036b1aa7ac7f319875730519 WatchSource:0}: Error finding container 23546c6e4573154f7749731b692d2117576de0f0036b1aa7ac7f319875730519: Status 404 returned error can't find the container with id 23546c6e4573154f7749731b692d2117576de0f0036b1aa7ac7f319875730519
Jun 03 15:49:00.091947 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.091912    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:00.096813 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.096787    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v"
Jun 03 15:49:00.099294 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.099268    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88976586_c663_4f59_853c_7003507980b4.slice/crio-7472452654b9942eca1715d9f39b836b5699b8cc00632fad345baf4fcc5ce302 WatchSource:0}: Error finding container 7472452654b9942eca1715d9f39b836b5699b8cc00632fad345baf4fcc5ce302: Status 404 returned error can't find the container with id 7472452654b9942eca1715d9f39b836b5699b8cc00632fad345baf4fcc5ce302
Jun 03 15:49:00.101650 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.101623    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5p74"
Jun 03 15:49:00.105054 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.105023    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eac3248_977d_4568_baa6_b27e5ca8f74f.slice/crio-e0830f3b4903f0a0f9239ff9953b6ff828730e8c8f328f4d4940a7b807ce770f WatchSource:0}: Error finding container e0830f3b4903f0a0f9239ff9953b6ff828730e8c8f328f4d4940a7b807ce770f: Status 404 returned error can't find the container with id e0830f3b4903f0a0f9239ff9953b6ff828730e8c8f328f4d4940a7b807ce770f
Jun 03 15:49:00.108440 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.107897    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-72gkk"
Jun 03 15:49:00.109834 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.109728    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311562ad_9379_4db5_9c0e_90fdef2313cf.slice/crio-572018e86e2a35200683ebe2a86b572de9ba25d8f850453f2138782969e79cc5 WatchSource:0}: Error finding container 572018e86e2a35200683ebe2a86b572de9ba25d8f850453f2138782969e79cc5: Status 404 returned error can't find the container with id 572018e86e2a35200683ebe2a86b572de9ba25d8f850453f2138782969e79cc5
Jun 03 15:49:00.113370 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.113214    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sl2wk"
Jun 03 15:49:00.116366 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.116342    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8238bcc6_33f7_4dcf_8dbf_dbc3d123b4d8.slice/crio-68c90aba9f0b931aa5ce41e35cfb34fbc202149d0f70eb0cff8acb9032d60e72 WatchSource:0}: Error finding container 68c90aba9f0b931aa5ce41e35cfb34fbc202149d0f70eb0cff8acb9032d60e72: Status 404 returned error can't find the container with id 68c90aba9f0b931aa5ce41e35cfb34fbc202149d0f70eb0cff8acb9032d60e72
Jun 03 15:49:00.119514 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.119484    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7vg6"
Jun 03 15:49:00.121634 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.121612    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e9a415_2331_4735_af63_73a38722ad39.slice/crio-0b7378bc8f016011b84f385465611fd2da0cd03a3356be74ee3cdfea31f1ae4f WatchSource:0}: Error finding container 0b7378bc8f016011b84f385465611fd2da0cd03a3356be74ee3cdfea31f1ae4f: Status 404 returned error can't find the container with id 0b7378bc8f016011b84f385465611fd2da0cd03a3356be74ee3cdfea31f1ae4f
Jun 03 15:49:00.125266 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.125243    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jphcf"
Jun 03 15:49:00.127049 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.127012    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a58d08d_e807_419b_b856_e5c1292b7c51.slice/crio-3b86e6a568afb4f727a4ec87bdf29808908a1681de8f4e950f62c43dcedd9ca8 WatchSource:0}: Error finding container 3b86e6a568afb4f727a4ec87bdf29808908a1681de8f4e950f62c43dcedd9ca8: Status 404 returned error can't find the container with id 3b86e6a568afb4f727a4ec87bdf29808908a1681de8f4e950f62c43dcedd9ca8
Jun 03 15:49:00.132534 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:00.132508    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20c3d02_0d81_4f56_b4bc_8bb201da511f.slice/crio-4d6062e670943f3ff4b1090f05ae8856e95834b4feca9f32212f83d0a96e2625 WatchSource:0}: Error finding container 4d6062e670943f3ff4b1090f05ae8856e95834b4feca9f32212f83d0a96e2625: Status 404 returned error can't find the container with id 4d6062e670943f3ff4b1090f05ae8856e95834b4feca9f32212f83d0a96e2625
Jun 03 15:49:00.261059 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.261017    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:49:00.335095 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.335006    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:00.335269 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.335143    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:00.335269 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.335200    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:01.335187539 +0000 UTC m=+3.053632629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:00.436176 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.436136    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:00.436348 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.436295    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:00.436348 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.436313    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:00.436348 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.436325    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:00.436474 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.436391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:01.436373719 +0000 UTC m=+3.154818817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:00.518074 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.518028    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:49:00.561292 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.560653    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-79fhh"]
Jun 03 15:49:00.576642 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.576052    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.576642 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.576163    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:00.638858 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.638758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-kubelet-config\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.638858 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.638841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.639576 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.638871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-dbus\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.739622    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-kubelet-config\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.739693    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.739719    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-dbus\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.739904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-dbus\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.739963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d159f76a-351c-4709-a7b5-657fd5529ac0-kubelet-config\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.740080    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:00.740360 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.740136    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:01.240118595 +0000 UTC m=+2.958563692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:00.802202 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.802146    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:43:59 +0000 UTC" deadline="2028-02-12 10:51:24.300311288 +0000 UTC"
Jun 03 15:49:00.802202 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.802189    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14851h2m23.498125812s"
Jun 03 15:49:00.821555 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.821524    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:00.821735 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:00.821680    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:00.852251 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.852207    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerStarted","Data":"68c90aba9f0b931aa5ce41e35cfb34fbc202149d0f70eb0cff8acb9032d60e72"}
Jun 03 15:49:00.878251 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.878210    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5p74" event={"ID":"311562ad-9379-4db5-9c0e-90fdef2313cf","Type":"ContainerStarted","Data":"572018e86e2a35200683ebe2a86b572de9ba25d8f850453f2138782969e79cc5"}
Jun 03 15:49:00.893744 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.893649    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v" event={"ID":"5eac3248-977d-4568-baa6-b27e5ca8f74f","Type":"ContainerStarted","Data":"e0830f3b4903f0a0f9239ff9953b6ff828730e8c8f328f4d4940a7b807ce770f"}
Jun 03 15:49:00.907178 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.907136    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"7472452654b9942eca1715d9f39b836b5699b8cc00632fad345baf4fcc5ce302"}
Jun 03 15:49:00.911341 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.911301    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5f5h" event={"ID":"a74849aa-ac32-4d0f-b356-0e2346d8afad","Type":"ContainerStarted","Data":"23546c6e4573154f7749731b692d2117576de0f0036b1aa7ac7f319875730519"}
Jun 03 15:49:00.922628 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.922572    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jphcf" event={"ID":"b20c3d02-0d81-4f56-b4bc-8bb201da511f","Type":"ContainerStarted","Data":"4d6062e670943f3ff4b1090f05ae8856e95834b4feca9f32212f83d0a96e2625"}
Jun 03 15:49:00.945748 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.945649    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7vg6" event={"ID":"4a58d08d-e807-419b-b856-e5c1292b7c51","Type":"ContainerStarted","Data":"3b86e6a568afb4f727a4ec87bdf29808908a1681de8f4e950f62c43dcedd9ca8"}
Jun 03 15:49:00.960713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.960481    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sl2wk" event={"ID":"71e9a415-2331-4735-af63-73a38722ad39","Type":"ContainerStarted","Data":"0b7378bc8f016011b84f385465611fd2da0cd03a3356be74ee3cdfea31f1ae4f"}
Jun 03 15:49:00.985950 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:00.985911    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gsw87" event={"ID":"141272c3-b793-4f3d-9ca7-ac87ae82bc00","Type":"ContainerStarted","Data":"3d1e32a50da3bb6c7b57e95ebff2fbbaf805942049d18eeb7a2702aa6298464e"}
Jun 03 15:49:01.244745 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.244655    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:01.244917 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.244808    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:01.244917 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.244873    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:02.24485448 +0000 UTC m=+3.963299571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:01.349825 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.345406    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:01.349825 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.345650    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:01.349825 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.345728    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:03.345708168 +0000 UTC m=+5.064153263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:01.446535 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.446495    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:01.446747 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.446658    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:01.446747 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.446678    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:01.446747 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.446690    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:01.446917 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.446749    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:03.446731647 +0000 UTC m=+5.165176743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:01.803537 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.803346    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:43:59 +0000 UTC" deadline="2028-03-20 11:01:26.081211512 +0000 UTC"
Jun 03 15:49:01.803537 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.803386    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15739h12m24.277828567s"
Jun 03 15:49:01.820075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:01.820031    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:01.820263 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:01.820164    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:02.252298 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:02.252194    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:02.252469 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:02.252329    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:02.252469 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:02.252391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:04.252374079 +0000 UTC m=+5.970819185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:02.813771 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:02.813387    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 15:49:02.822025 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:02.820193    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:02.822025 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:02.820193    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:02.822025 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:02.820339    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:02.822025 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:02.820448    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:03.365746 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:03.365142    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:03.365746 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.365324    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:03.365746 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.365390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:07.365372428 +0000 UTC m=+9.083817534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:03.465644 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:03.465600    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:03.465833 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.465804    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:03.465833 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.465825    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:03.465951 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.465839    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:03.465951 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.465898    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:07.465881242 +0000 UTC m=+9.184326333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:03.820745 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:03.820202    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:03.820745 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:03.820315    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:04.277820 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:04.277726    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:04.278060 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:04.277900    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:04.278060 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:04.277996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:08.277957334 +0000 UTC m=+9.996402448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:04.821385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:04.821154    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:04.821385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:04.821198    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:04.821385 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:04.821305    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:04.822147 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:04.821456    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:05.820541 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:05.820043    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:05.820541 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:05.820169    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:06.821643 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:06.819697    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:06.821643 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:06.819705    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:06.821643 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:06.819847    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:06.821643 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:06.819922    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:07.405686 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:07.405618    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:07.405885 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.405784    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:07.405885 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.405833    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:15.405819927 +0000 UTC m=+17.124265019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:07.506994 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:07.506943    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:07.507185 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.507120    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:07.507185 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.507142    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:07.507185 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.507152    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:07.507284 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.507206    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:15.507193078 +0000 UTC m=+17.225638169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:07.820597 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:07.820508    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:07.820779 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:07.820635    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:08.314421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:08.314232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:08.314421 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:08.314380    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:08.314859 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:08.314447    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:16.314433281 +0000 UTC m=+18.032878372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:08.820341 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:08.820304    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:08.820507 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:08.820408    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:08.820507 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:08.820485    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:08.820588 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:08.820571    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:09.820188 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:09.820147    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:09.820663 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:09.820282    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:10.820776 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:10.820163    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:10.820776 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:10.820218    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:10.820776 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:10.820316    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:10.820776 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:10.820730    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:11.820481 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:11.820394    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:11.820634 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:11.820528    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:12.820675 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:12.820197    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:12.820675 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:12.820197    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:12.820675 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:12.820330    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:12.820675 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:12.820386    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:13.820456 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:13.820413    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:13.820638 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:13.820560    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:14.819728 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:14.819690    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:14.820229 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:14.819819    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:14.820229 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:14.819906    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:14.820229 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:14.820026    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:15.470623 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:15.470521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:15.470812 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.470705    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:15.470812 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.470773    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:49:31.470755323 +0000 UTC m=+33.189200415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:15.571954 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:15.571914    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:15.572156 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.572139    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:15.572219 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.572169    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:15.572219 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.572183    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:15.572316 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.572241    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:31.572227448 +0000 UTC m=+33.290672542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:15.820233 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:15.820142    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:15.820723 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:15.820281    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:16.378227 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:16.378181    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:16.378461 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:16.378335    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:16.378461 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:16.378406    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:32.378391993 +0000 UTC m=+34.096837084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:16.820531 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:16.820434    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:16.820531 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:16.820464    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:16.821047 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:16.820583    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:16.821047 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:16.820721    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:17.820061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:17.820018    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:17.820227 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:17.820159    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:18.821083 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:18.821042    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:18.821500 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:18.821174    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:18.821500 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:18.821206    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:18.821500 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:18.821252    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:19.819728 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:19.819690    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:19.819910 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:19.819790    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:20.820097 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:20.819755    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:20.820780 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:20.820194    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:20.820780 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:20.819772    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:20.820780 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:20.820309    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:21.032892 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.032851    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="dfdece02f35cf3ccf67ffee8faeb28d5cb2b2030fa0d30a073b9f9266d4b691c" exitCode=0
Jun 03 15:49:21.033095 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.032939    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"dfdece02f35cf3ccf67ffee8faeb28d5cb2b2030fa0d30a073b9f9266d4b691c"}
Jun 03 15:49:21.034524 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.034405    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5p74" event={"ID":"311562ad-9379-4db5-9c0e-90fdef2313cf","Type":"ContainerStarted","Data":"81ebd7cfd432aa57592d98f75afb484709cc379f5f5544918b9adb3feceac08a"}
Jun 03 15:49:21.035824 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.035801    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v" event={"ID":"5eac3248-977d-4568-baa6-b27e5ca8f74f","Type":"ContainerStarted","Data":"943e7c5054cea30ce1e8f54f88790f9c874583a19d4020c0fc941c77f842c57a"}
Jun 03 15:49:21.038368 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:49:21.038722 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038701    2562 generic.go:358] "Generic (PLEG): container finished" podID="88976586-c663-4f59-853c-7003507980b4" containerID="84cb03eff07d6a65ee45467a3b45832f3139f6fb214327f0ce42172fb8c74a26" exitCode=1
Jun 03 15:49:21.038822 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038757    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"c3a17b9f00a07f0084ac12bca3d27bf2ee84548eab5d4d30c07dd9a27b75bb12"}
Jun 03 15:49:21.038822 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038790    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"f25eceabce2968b709ab239356c991fbbafff43b56ed9e8abe6f52847fb695a7"}
Jun 03 15:49:21.038822 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038800    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"64bb1cf7b7b298642148c4f82e5f25faee1a35d120e0d3eca5d4261b724e0596"}
Jun 03 15:49:21.038822 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038808    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"dfdcf3fc5e89ff572526ca05c48a040a0f458d2640597e6e51ee060f1f283cfc"}
Jun 03 15:49:21.038822 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038818    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerDied","Data":"84cb03eff07d6a65ee45467a3b45832f3139f6fb214327f0ce42172fb8c74a26"}
Jun 03 15:49:21.039102 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.038832    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"2dda0261f0680db3cfd5872427ee2d6849c7423b259ef8029d1dd92e9c2eed49"}
Jun 03 15:49:21.040538 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.040494    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5f5h" event={"ID":"a74849aa-ac32-4d0f-b356-0e2346d8afad","Type":"ContainerStarted","Data":"471890c0f7d2bed1ea6c2f3fee8580399aa671c47bc6e15620f9f764e9d8020b"}
Jun 03 15:49:21.042001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.041948    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jphcf" event={"ID":"b20c3d02-0d81-4f56-b4bc-8bb201da511f","Type":"ContainerStarted","Data":"8be3a68454f07065c7a8f1263a767866162392f6855d71f4fdda1b69a8d3e978"}
Jun 03 15:49:21.043284 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.043259    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sl2wk" event={"ID":"71e9a415-2331-4735-af63-73a38722ad39","Type":"ContainerStarted","Data":"6367d668ee3ffe064fce6b6ad88c587eba312843630ed0d0caa11fec241b0490"}
Jun 03 15:49:21.044418 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.044397    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gsw87" event={"ID":"141272c3-b793-4f3d-9ca7-ac87ae82bc00","Type":"ContainerStarted","Data":"a559f923b003dfdd7e0257f731e364a408b3e459b16683c767c20236a907c7ea"}
Jun 03 15:49:21.046048 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.046024    2562 generic.go:358] "Generic (PLEG): container finished" podID="75e14fdc012467c7bfae7c515b816e0c" containerID="4da6f8663e6be91e1b0f58a4cde6c07af6e549f3801fc9226fd9db97707950d5" exitCode=0
Jun 03 15:49:21.046147 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.046096    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal" event={"ID":"75e14fdc012467c7bfae7c515b816e0c","Type":"ContainerDied","Data":"4da6f8663e6be91e1b0f58a4cde6c07af6e549f3801fc9226fd9db97707950d5"}
Jun 03 15:49:21.047260 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.047240    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal" event={"ID":"141341a8c185dbd90d002b2037e0f25d","Type":"ContainerStarted","Data":"147adf2fce30c72a65d62e4e0749555c775aa9101c6dc258d346c92d7ac40e02"}
Jun 03 15:49:21.108038 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.107959    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jphcf" podStartSLOduration=2.285343193 podStartE2EDuration="22.107944597s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.134056974 +0000 UTC m=+1.852502065" lastFinishedPulling="2026-06-03 15:49:19.956658375 +0000 UTC m=+21.675103469" observedRunningTime="2026-06-03 15:49:21.087075351 +0000 UTC m=+22.805520465" watchObservedRunningTime="2026-06-03 15:49:21.107944597 +0000 UTC m=+22.826389710"
Jun 03 15:49:21.108244 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.108224    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-102.ec2.internal" podStartSLOduration=22.108218718 podStartE2EDuration="22.108218718s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:21.107693932 +0000 UTC m=+22.826139047" watchObservedRunningTime="2026-06-03 15:49:21.108218718 +0000 UTC m=+22.826663831"
Jun 03 15:49:21.157080 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.157028    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gsw87" podStartSLOduration=3.289133256 podStartE2EDuration="23.157010857s" podCreationTimestamp="2026-06-03 15:48:58 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.047063932 +0000 UTC m=+1.765509024" lastFinishedPulling="2026-06-03 15:49:19.914941531 +0000 UTC m=+21.633386625" observedRunningTime="2026-06-03 15:49:21.129869042 +0000 UTC m=+22.848314155" watchObservedRunningTime="2026-06-03 15:49:21.157010857 +0000 UTC m=+22.875455952"
Jun 03 15:49:21.157611 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.157581    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g5f5h" podStartSLOduration=7.801002407 podStartE2EDuration="23.157570826s" podCreationTimestamp="2026-06-03 15:48:58 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.060683215 +0000 UTC m=+1.779128306" lastFinishedPulling="2026-06-03 15:49:15.417251621 +0000 UTC m=+17.135696725" observedRunningTime="2026-06-03 15:49:21.157488083 +0000 UTC m=+22.875933196" watchObservedRunningTime="2026-06-03 15:49:21.157570826 +0000 UTC m=+22.876015938"
Jun 03 15:49:21.211405 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.211350    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-r5p74" podStartSLOduration=2.367752877 podStartE2EDuration="22.211332776s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.111827603 +0000 UTC m=+1.830272709" lastFinishedPulling="2026-06-03 15:49:19.955407496 +0000 UTC m=+21.673852608" observedRunningTime="2026-06-03 15:49:21.185026937 +0000 UTC m=+22.903472051" watchObservedRunningTime="2026-06-03 15:49:21.211332776 +0000 UTC m=+22.929777889"
Jun 03 15:49:21.211572 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.211510    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-sl2wk" podStartSLOduration=2.023120485 podStartE2EDuration="22.211505661s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.123828274 +0000 UTC m=+1.842273381" lastFinishedPulling="2026-06-03 15:49:20.312213464 +0000 UTC m=+22.030658557" observedRunningTime="2026-06-03 15:49:21.211055049 +0000 UTC m=+22.929500161" watchObservedRunningTime="2026-06-03 15:49:21.211505661 +0000 UTC m=+22.929950774"
Jun 03 15:49:21.820619 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.820587    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:21.821097 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:21.820690    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:21.886154 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:21.886110    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 15:49:22.051905 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.051807    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v" event={"ID":"5eac3248-977d-4568-baa6-b27e5ca8f74f","Type":"ContainerStarted","Data":"f044f93d823ba26ff17eacd1eb77c89abcd8b7ddc129f627fb4e922403a2bf50"}
Jun 03 15:49:22.053671 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.053458    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7vg6" event={"ID":"4a58d08d-e807-419b-b856-e5c1292b7c51","Type":"ContainerStarted","Data":"5b727ac3d727eb1ea9aadccc0576712670c6a32ce1fffaf307f2e869a249fb97"}
Jun 03 15:49:22.090273 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.090207    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b7vg6" podStartSLOduration=3.260842425 podStartE2EDuration="23.090187939s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.128576854 +0000 UTC m=+1.847021945" lastFinishedPulling="2026-06-03 15:49:19.957922364 +0000 UTC m=+21.676367459" observedRunningTime="2026-06-03 15:49:22.089609742 +0000 UTC m=+23.808054855" watchObservedRunningTime="2026-06-03 15:49:22.090187939 +0000 UTC m=+23.808633054"
Jun 03 15:49:22.794760 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.794665    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:49:21.886133885Z","UUID":"55b74132-3e57-482e-b4b1-aca700ccfa9b","Handler":null,"Name":"","Endpoint":""}
Jun 03 15:49:22.798612 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.798585    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 15:49:22.798612 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.798620    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 15:49:22.820714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.820684    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:22.821248 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:22.820683    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:22.821248 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:22.820812    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:22.821248 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:22.820875    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:23.057605 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:23.057359    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal" event={"ID":"75e14fdc012467c7bfae7c515b816e0c","Type":"ContainerStarted","Data":"4fc58086188bf8adecc21e67a1b93f800ff03e1cc8b2559eceba44e49539512e"}
Jun 03 15:49:23.820303 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:23.820266    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:23.820511 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:23.820407    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:24.062010 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.061956    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v" event={"ID":"5eac3248-977d-4568-baa6-b27e5ca8f74f","Type":"ContainerStarted","Data":"89c7abea48b900f972d5b9855137d027536085e581c45c47676e6f2306cbd58c"}
Jun 03 15:49:24.065195 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.065170    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:49:24.065555 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.065532    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"fe2483b9e872eccea431686916c279dc850300c736f3942ae9d0e35e8102978b"}
Jun 03 15:49:24.096300 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.096243    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-102.ec2.internal" podStartSLOduration=25.096223909 podStartE2EDuration="25.096223909s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:23.083328573 +0000 UTC m=+24.801773686" watchObservedRunningTime="2026-06-03 15:49:24.096223909 +0000 UTC m=+25.814669023"
Jun 03 15:49:24.096484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.096407    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mld8v" podStartSLOduration=2.196744428 podStartE2EDuration="25.096400126s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.108957511 +0000 UTC m=+1.827402617" lastFinishedPulling="2026-06-03 15:49:23.008613221 +0000 UTC m=+24.727058315" observedRunningTime="2026-06-03 15:49:24.096371165 +0000 UTC m=+25.814816259" watchObservedRunningTime="2026-06-03 15:49:24.096400126 +0000 UTC m=+25.814845252"
Jun 03 15:49:24.820464 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.820411    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:24.820636 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:24.820411    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:24.820636 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:24.820549    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:24.820636 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:24.820607    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:25.100517 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:25.100475    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:49:25.101335 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:25.101308    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:49:25.820076 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:25.820035    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:25.820263 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:25.820179    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:26.069340 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:26.069305    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:49:26.069853 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:26.069836    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gsw87"
Jun 03 15:49:26.820067 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:26.819961    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:26.820636 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:26.819961    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:26.820636 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:26.820108    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:26.820636 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:26.820174    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:27.072705 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.072616    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="e922865f0dc3a497437b00e95f648b44cd816c11651328679d63a8e3f632bcd1" exitCode=0
Jun 03 15:49:27.072705 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.072697    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"e922865f0dc3a497437b00e95f648b44cd816c11651328679d63a8e3f632bcd1"}
Jun 03 15:49:27.079167 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.079147    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:49:27.079521 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.079500    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"30029fd765d7dafa26f7d093cc4f5de365b4cfe899ec1d99e8698801fc313bf7"}
Jun 03 15:49:27.079843 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.079819    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:27.079942 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.079856    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:27.080028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.080019    2562 scope.go:117] "RemoveContainer" containerID="84cb03eff07d6a65ee45467a3b45832f3139f6fb214327f0ce42172fb8c74a26"
Jun 03 15:49:27.097148 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.097122    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:27.097250 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.097216    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:27.819700 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:27.819664    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:27.819888 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:27.819803    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:28.084461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.084423    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerStarted","Data":"28cb3cabe0bd8c9aca03de0451fb8d7f9dbf2a8aa11485561c1dac537dc9cf48"}
Jun 03 15:49:28.088592 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.088568    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:49:28.088926 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.088897    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" event={"ID":"88976586-c663-4f59-853c-7003507980b4","Type":"ContainerStarted","Data":"3ae77864c62b98051f8f2a2561fe2d1a15b257d4c710c4e6e58e6525ea339eda"}
Jun 03 15:49:28.089238 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.089208    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 15:49:28.330029 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.329756    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5" podStartSLOduration=9.226368145 podStartE2EDuration="29.329734849s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.101467369 +0000 UTC m=+1.819912463" lastFinishedPulling="2026-06-03 15:49:20.20483407 +0000 UTC m=+21.923279167" observedRunningTime="2026-06-03 15:49:28.170699756 +0000 UTC m=+29.889144880" watchObservedRunningTime="2026-06-03 15:49:28.329734849 +0000 UTC m=+30.048179962"
Jun 03 15:49:28.330385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.330364    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvdxf"]
Jun 03 15:49:28.330497 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.330482    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:28.330639 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:28.330617    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:28.331936 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.331853    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-79fhh"]
Jun 03 15:49:28.332075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.331953    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:28.332075 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:28.332049    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:28.364312 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.364277    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8n47"]
Jun 03 15:49:28.364475 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:28.364416    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:28.364553 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:28.364535    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:29.092851 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.092816    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="28cb3cabe0bd8c9aca03de0451fb8d7f9dbf2a8aa11485561c1dac537dc9cf48" exitCode=0
Jun 03 15:49:29.092851 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.092843    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="ea244d909b143e58b94f50465374595aa4fe04ada18b7214f72c8e4cd7ff4440" exitCode=0
Jun 03 15:49:29.093405 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.092904    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"28cb3cabe0bd8c9aca03de0451fb8d7f9dbf2a8aa11485561c1dac537dc9cf48"}
Jun 03 15:49:29.093405 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.092940    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"ea244d909b143e58b94f50465374595aa4fe04ada18b7214f72c8e4cd7ff4440"}
Jun 03 15:49:29.093405 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.093036    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 15:49:29.820292 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.820258    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:29.820489 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:29.820368    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:29.820710 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.820693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:29.820788 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:29.820773    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:29.820850 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.820830    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:29.820907 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:29.820896    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:29.927427 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:29.927392    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:49:31.488216 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:31.488174    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:31.488905 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.488337    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:31.488905 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.488415    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:50:03.48839623 +0000 UTC m=+65.206841322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 15:49:31.588714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:31.588672    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:31.588918 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.588868    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 15:49:31.588918 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.588898    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 15:49:31.588918 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.588911    2562 projected.go:194] Error preparing data for projected volume kube-api-access-9jcpn for pod openshift-network-diagnostics/network-check-target-hvdxf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:31.589070 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.588963    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn podName:13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:03.588943456 +0000 UTC m=+65.307388547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9jcpn" (UniqueName: "kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn") pod "network-check-target-hvdxf" (UID: "13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 15:49:31.819784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:31.819695    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:31.819784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:31.819735    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:31.820111 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:31.819698    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:31.820111 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.819830    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvdxf" podUID="13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0"
Jun 03 15:49:31.820111 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.819998    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8n47" podUID="2c0300be-0c52-4fcf-a35f-eb646dafd23e"
Jun 03 15:49:31.820111 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:31.820060    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-79fhh" podUID="d159f76a-351c-4709-a7b5-657fd5529ac0"
Jun 03 15:49:32.393913 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:32.393865    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:32.394087 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:32.394005    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:32.394087 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:32.394064    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret podName:d159f76a-351c-4709-a7b5-657fd5529ac0 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:04.39405014 +0000 UTC m=+66.112495230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret") pod "global-pull-secret-syncer-79fhh" (UID: "d159f76a-351c-4709-a7b5-657fd5529ac0") : object "kube-system"/"original-pull-secret" not registered
Jun 03 15:49:33.141452 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.141183    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-102.ec2.internal" event="NodeReady"
Jun 03 15:49:33.141936 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.141548    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 15:49:33.209774 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.209724    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dtz65"]
Jun 03 15:49:33.233859 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.233826    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"]
Jun 03 15:49:33.234064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.234032    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.237968 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.237823    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.238181 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.238162    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 03 15:49:33.239739 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.239714    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jr5df\""
Jun 03 15:49:33.239952 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.239928    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.240104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.240089    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 03 15:49:33.246482 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.246453    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"]
Jun 03 15:49:33.246864 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.246835    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.248020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.247993    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 03 15:49:33.252039 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.250862    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 03 15:49:33.252039 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.251415    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 03 15:49:33.252039 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.251682    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.252039 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.251782    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bqppd\""
Jun 03 15:49:33.252039 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.251935    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.262486 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.262387    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"]
Jun 03 15:49:33.262652 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.262633    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"
Jun 03 15:49:33.266008 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.265148    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.266008 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.265577    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fnngw\""
Jun 03 15:49:33.266008 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.265718    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.267792 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.267757    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"]
Jun 03 15:49:33.267952 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.267936    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.279185    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.279218    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.279372    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.280117    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9q8sr\""
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.280121    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.280236    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.280484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.280238    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 03 15:49:33.283866 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.283840    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 03 15:49:33.284308 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.283900    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 03 15:49:33.284308 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.283942    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.284308 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.283942    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.284308 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.283942    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w7cqp\""
Jun 03 15:49:33.294935 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.294905    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5lrcg"]
Jun 03 15:49:33.310549 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.310504    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"]
Jun 03 15:49:33.310909 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.310886    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.311761 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.310904    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.319701 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.319593    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 15:49:33.320610 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.320586    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 15:49:33.320610 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.320601    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 03 15:49:33.320860 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.320845    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9jcgk\""
Jun 03 15:49:33.322911 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.322887    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q22fp\""
Jun 03 15:49:33.323274 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.323232    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 15:49:33.323939 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.323920    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.324282 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.324260    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.325157 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.325138    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 03 15:49:33.328707 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328685    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dtz65"]
Jun 03 15:49:33.328707 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328712    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"]
Jun 03 15:49:33.328907 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328722    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"]
Jun 03 15:49:33.328907 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328734    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"]
Jun 03 15:49:33.328907 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328749    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-595576bf8c-cp6dz"]
Jun 03 15:49:33.329127 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.328939    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.333202 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.333177    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.333202 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.333193    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.333476 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.333457    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 03 15:49:33.333720 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.333702    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qjgb7\""
Jun 03 15:49:33.344541 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.344511    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 03 15:49:33.347003 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.346083    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:49:33.347003 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.346115    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4zmt8"]
Jun 03 15:49:33.347003 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.346287    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.347654 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.347631    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 15:49:33.349072 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.349050    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 03 15:49:33.349887 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.349869    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 03 15:49:33.350176 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.350143    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.350285 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.350198    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 03 15:49:33.350285 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.350209    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 03 15:49:33.350924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.350908    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.351126 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.351113    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nqcnz\""
Jun 03 15:49:33.373694 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.373657    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"]
Jun 03 15:49:33.373884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.373805    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.385235 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.385208    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"]
Jun 03 15:49:33.385382 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.385365    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.386687 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.386664    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.386687 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.386686    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.388485 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.388458    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 15:49:33.388793 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.388777    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\""
Jun 03 15:49:33.389140 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.389126    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.389303 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.389291    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.389867 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.389846    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 03 15:49:33.390144 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.390128    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 03 15:49:33.399418 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-tmp\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.399565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwwn\" (UniqueName: \"kubernetes.io/projected/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-kube-api-access-rlwwn\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.399565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-config\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.399565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.399565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnq7\" (UniqueName: \"kubernetes.io/projected/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-kube-api-access-bxnq7\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.399565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-config\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-service-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5dr\" (UniqueName: \"kubernetes.io/projected/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-kube-api-access-gr5dr\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399676    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a6673a-b8ef-4140-a086-ede4fb74aa17-serving-cert\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.399781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-snapshots\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5zx\" (UniqueName: \"kubernetes.io/projected/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-kube-api-access-wd5zx\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-serving-cert\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbqq\" (UniqueName: \"kubernetes.io/projected/05ca1d00-2cba-47bf-89f1-cb2a714c8b7f-kube-api-access-jqbqq\") pod \"volume-data-source-validator-7598fd5bd-svcln\" (UID: \"05ca1d00-2cba-47bf-89f1-cb2a714c8b7f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.399938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.400116 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-trusted-ca\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.400542 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-serving-cert\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.400542 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9p8\" (UniqueName: \"kubernetes.io/projected/32a6673a-b8ef-4140-a086-ede4fb74aa17-kube-api-access-bs9p8\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.400542 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.400542 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcks4\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.400542 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.400333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.403827 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.403802    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"]
Jun 03 15:49:33.403993 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.403951    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.411026 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.411000    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gfxcc\""
Jun 03 15:49:33.411504 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.411472    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 03 15:49:33.423836 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.423801    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"]
Jun 03 15:49:33.424031 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.423964    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.434641 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.434611    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 03 15:49:33.434855 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.434617    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k7x8c\""
Jun 03 15:49:33.435852 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.435829    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 03 15:49:33.445943 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.445911    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"]
Jun 03 15:49:33.446147 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.446051    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"
Jun 03 15:49:33.450250 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.450225    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v947z\""
Jun 03 15:49:33.450250 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.450229    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 15:49:33.450429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.450262    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 15:49:33.468179 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468142    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"]
Jun 03 15:49:33.468179 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468183    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5lrcg"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468196    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468212    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468224    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468234    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468245    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4zmt8"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468255    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-595576bf8c-cp6dz"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468264    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468278    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468291    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2r64w"]
Jun 03 15:49:33.468444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.468299    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.485075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.484563    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 03 15:49:33.485075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.484862    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 03 15:49:33.491743 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.491711    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 03 15:49:33.492139 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.492114    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2r64w"]
Jun 03 15:49:33.492275 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.492258    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.497861 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.497838    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 15:49:33.499898 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.499877    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\""
Jun 03 15:49:33.501109 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fssn7\" (UniqueName: \"kubernetes.io/projected/60f87a9a-7c7f-4922-802a-29cef828f6c9-kube-api-access-fssn7\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.501177 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgjm\" (UniqueName: \"kubernetes.io/projected/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-kube-api-access-swgjm\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.501177 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-stats-auth\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.501177 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.501307 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501237    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9p8\" (UniqueName: \"kubernetes.io/projected/32a6673a-b8ef-4140-a086-ede4fb74aa17-kube-api-access-bs9p8\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.501307 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501269    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.501307 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9hp\" (UniqueName: \"kubernetes.io/projected/10798e32-9ffa-44ed-a408-c2ff6e562dd0-kube-api-access-ss9hp\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.501445 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501320    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcks4\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.501445 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501350    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.501445 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.501445 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.501445 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501434    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-tmp\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501496    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwwn\" (UniqueName: \"kubernetes.io/projected/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-kube-api-access-rlwwn\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501530    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-config\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-tmp\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kl7\" (UniqueName: \"kubernetes.io/projected/621e2760-8775-489e-afb5-d3fcbe7f74cd-kube-api-access-92kl7\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501638    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.501697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501679    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnq7\" (UniqueName: \"kubernetes.io/projected/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-kube-api-access-bxnq7\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501719    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-config\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501750    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-service-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501773    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501796    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501812    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-tmp\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501820    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5dr\" (UniqueName: \"kubernetes.io/projected/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-kube-api-access-gr5dr\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501853    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a6673a-b8ef-4140-a086-ede4fb74aa17-serving-cert\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501883    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh4jt\" (UniqueName: \"kubernetes.io/projected/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-kube-api-access-rh4jt\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501939    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502001 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.501968    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-snapshots\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502036    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5zx\" (UniqueName: \"kubernetes.io/projected/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-kube-api-access-wd5zx\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502090    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-serving-cert\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502114    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbqq\" (UniqueName: \"kubernetes.io/projected/05ca1d00-2cba-47bf-89f1-cb2a714c8b7f-kube-api-access-jqbqq\") pod \"volume-data-source-validator-7598fd5bd-svcln\" (UID: \"05ca1d00-2cba-47bf-89f1-cb2a714c8b7f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-default-certificate\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502200    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502290    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502344    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502347    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-config\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.502502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502368    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-trusted-ca\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502392    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-serving-cert\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502475    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-config\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.502518    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.502555    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.502621    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.002603485 +0000 UTC m=+35.721048577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:33.503104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.503053    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/32a6673a-b8ef-4140-a086-ede4fb74aa17-snapshots\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.503546 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.503158    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:33.503546 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.503171    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:33.503546 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.503217    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.003200725 +0000 UTC m=+35.721645820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:33.503686 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.503649    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.505108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.503774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.505108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.503921    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 15:49:33.505108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.504322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-service-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.505108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.504474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.505108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.505064    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32a6673a-b8ef-4140-a086-ede4fb74aa17-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.505431 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.505393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-trusted-ca\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.506905 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.506881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.507060 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.506885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-serving-cert\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.507060 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.507024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.507317 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.507299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32a6673a-b8ef-4140-a086-ede4fb74aa17-serving-cert\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.507410 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.507381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.507634 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.507615    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-serving-cert\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.536023 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.535961    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 03 15:49:33.539277 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.539250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9p8\" (UniqueName: \"kubernetes.io/projected/32a6673a-b8ef-4140-a086-ede4fb74aa17-kube-api-access-bs9p8\") pod \"insights-operator-788bf58df5-dtz65\" (UID: \"32a6673a-b8ef-4140-a086-ede4fb74aa17\") " pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.546761 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.546733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwwn\" (UniqueName: \"kubernetes.io/projected/a1fae33f-e500-42a8-b32b-8ca4d5ec82ac-kube-api-access-rlwwn\") pod \"service-ca-operator-69877444c-44fs6\" (UID: \"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.546899 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.546805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5zx\" (UniqueName: \"kubernetes.io/projected/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-kube-api-access-wd5zx\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:33.548215 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.548192    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dtz65"
Jun 03 15:49:33.548836 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.548806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5dr\" (UniqueName: \"kubernetes.io/projected/aba055c2-fc0c-4473-abdc-ee2f24efa1d7-kube-api-access-gr5dr\") pod \"console-operator-86d7c6cc77-5lrcg\" (UID: \"aba055c2-fc0c-4473-abdc-ee2f24efa1d7\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.550223 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.550202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbqq\" (UniqueName: \"kubernetes.io/projected/05ca1d00-2cba-47bf-89f1-cb2a714c8b7f-kube-api-access-jqbqq\") pod \"volume-data-source-validator-7598fd5bd-svcln\" (UID: \"05ca1d00-2cba-47bf-89f1-cb2a714c8b7f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"
Jun 03 15:49:33.571447 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.571411    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnq7\" (UniqueName: \"kubernetes.io/projected/d863496a-7e17-4cc8-99d8-5d13ee7d2de4-kube-api-access-bxnq7\") pod \"kube-storage-version-migrator-operator-96ddc787c-zjlxt\" (UID: \"d863496a-7e17-4cc8-99d8-5d13ee7d2de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:33.575241 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.575211    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.575401 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.575378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcks4\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:33.576876 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.576852    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"
Jun 03 15:49:33.594856 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.594821    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"
Jun 03 15:49:33.602828 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.602792    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.603030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.602840    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.603030 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.602933    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:33.603030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.602971    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-tmp\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.603030 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.602991    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.102957605 +0000 UTC m=+35.821402696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:33.603268 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.603038    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.103019044 +0000 UTC m=+35.821464142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:33.603268 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4825r\" (UniqueName: \"kubernetes.io/projected/818bccad-ae01-414d-a772-f7e6ab770c68-kube-api-access-4825r\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.603268 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw4ft\" (UniqueName: \"kubernetes.io/projected/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-kube-api-access-rw4ft\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.603268 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603153    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92kl7\" (UniqueName: \"kubernetes.io/projected/621e2760-8775-489e-afb5-d3fcbe7f74cd-kube-api-access-92kl7\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.603268 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-tmp\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3dd312-b361-41d0-aca5-dbc75fd21d16-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-config-volume\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603459    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh4jt\" (UniqueName: \"kubernetes.io/projected/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-kube-api-access-rh4jt\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603512    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-default-certificate\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.603557 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603544    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603573    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/818bccad-ae01-414d-a772-f7e6ab770c68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56mf\" (UniqueName: \"kubernetes.io/projected/57b1f474-9ade-48e5-ba86-06e8f6668df9-kube-api-access-p56mf\") pod \"network-check-source-56d84b9f44-z6hcf\" (UID: \"57b1f474-9ade-48e5-ba86-06e8f6668df9\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.603724    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-tmp-dir\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.603789    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.103771918 +0000 UTC m=+35.822217010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603811    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fssn7\" (UniqueName: \"kubernetes.io/projected/60f87a9a-7c7f-4922-802a-29cef828f6c9-kube-api-access-fssn7\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603839    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swgjm\" (UniqueName: \"kubernetes.io/projected/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-kube-api-access-swgjm\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.603884 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603894    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-stats-auth\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603927    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.603990    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9hp\" (UniqueName: \"kubernetes.io/projected/10798e32-9ffa-44ed-a408-c2ff6e562dd0-kube-api-access-ss9hp\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.604016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.604046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.604132    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:33.605061 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.604169    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.104158554 +0000 UTC m=+35.822603645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:33.606560 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.606538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-default-certificate\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.606808 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.606788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-stats-auth\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.607063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.607040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-klusterlet-config\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.607157 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.607092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.623916 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.623882    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:33.629651 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.629605    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kl7\" (UniqueName: \"kubernetes.io/projected/621e2760-8775-489e-afb5-d3fcbe7f74cd-kube-api-access-92kl7\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:33.631996 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.631958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9hp\" (UniqueName: \"kubernetes.io/projected/10798e32-9ffa-44ed-a408-c2ff6e562dd0-kube-api-access-ss9hp\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:33.633738 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.633711    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgjm\" (UniqueName: \"kubernetes.io/projected/3760a11a-7f92-4a32-b9a4-3b0f5cf816d1-kube-api-access-swgjm\") pod \"klusterlet-addon-workmgr-dfc87bd9f-lzzt6\" (UID: \"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.637347 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.637315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh4jt\" (UniqueName: \"kubernetes.io/projected/662ffcfa-ae06-4bfe-b8e9-72044ee26b02-kube-api-access-rh4jt\") pod \"managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4\" (UID: \"662ffcfa-ae06-4bfe-b8e9-72044ee26b02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.659738 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.659662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fssn7\" (UniqueName: \"kubernetes.io/projected/60f87a9a-7c7f-4922-802a-29cef828f6c9-kube-api-access-fssn7\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:33.696297 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.696260    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:33.705354 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705318    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p56mf\" (UniqueName: \"kubernetes.io/projected/57b1f474-9ade-48e5-ba86-06e8f6668df9-kube-api-access-p56mf\") pod \"network-check-source-56d84b9f44-z6hcf\" (UID: \"57b1f474-9ade-48e5-ba86-06e8f6668df9\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"
Jun 03 15:49:33.705354 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705357    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705398    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-tmp-dir\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705420    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705464    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705491    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705547    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4825r\" (UniqueName: \"kubernetes.io/projected/818bccad-ae01-414d-a772-f7e6ab770c68-kube-api-access-4825r\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.705574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705574    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw4ft\" (UniqueName: \"kubernetes.io/projected/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-kube-api-access-rw4ft\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705607    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705649    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3dd312-b361-41d0-aca5-dbc75fd21d16-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705675    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-config-volume\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705771    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/818bccad-ae01-414d-a772-f7e6ab770c68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-tmp-dir\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.705874 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.705871    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:33.706215 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.705891    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:33.706215 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.705936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.205912523 +0000 UTC m=+35.924357613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:33.706215 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:33.705957    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:34.205947021 +0000 UTC m=+35.924392112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:33.706469 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.705803    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.706571 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.706550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3dd312-b361-41d0-aca5-dbc75fd21d16-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:33.706736 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.706715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-config-volume\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.707257 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.707226    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/818bccad-ae01-414d-a772-f7e6ab770c68-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.708932 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.708886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.709092 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.709075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-ca\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.709189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.709102    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.710383 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.710351    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/818bccad-ae01-414d-a772-f7e6ab770c68-hub\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.725677 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.725651    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw4ft\" (UniqueName: \"kubernetes.io/projected/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-kube-api-access-rw4ft\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:33.726281 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.726251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56mf\" (UniqueName: \"kubernetes.io/projected/57b1f474-9ade-48e5-ba86-06e8f6668df9-kube-api-access-p56mf\") pod \"network-check-source-56d84b9f44-z6hcf\" (UID: \"57b1f474-9ade-48e5-ba86-06e8f6668df9\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"
Jun 03 15:49:33.730953 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.730919    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"
Jun 03 15:49:33.735438 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.735403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4825r\" (UniqueName: \"kubernetes.io/projected/818bccad-ae01-414d-a772-f7e6ab770c68-kube-api-access-4825r\") pod \"cluster-proxy-proxy-agent-6944d6c896-s8bq6\" (UID: \"818bccad-ae01-414d-a772-f7e6ab770c68\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.756880 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.756846    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"
Jun 03 15:49:33.779825 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.779790    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:49:33.819891 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.819854    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:49:33.819891 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.819876    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:49:33.820151 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.820007    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:49:33.824158 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.824126    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 15:49:33.824642 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.824622    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 15:49:33.825053 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.825030    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\""
Jun 03 15:49:33.825417 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.825395    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\""
Jun 03 15:49:33.866554 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:33.866519    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"
Jun 03 15:49:34.009497 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.009411    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:34.009689 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.009586    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:34.009689 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.009609    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:34.009689 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.009619    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:34.009689 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.009682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.009659314 +0000 UTC m=+36.728104421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:34.009885 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.009750    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:34.009885 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.009808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.009791624 +0000 UTC m=+36.728236718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:34.110633 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.110589    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:34.110845 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.110652    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:34.110845 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.110762    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.110740085 +0000 UTC m=+36.829185176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:34.110845 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.110823    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:34.110845 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.110832    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.110882    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.110866498 +0000 UTC m=+36.829311589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.110922    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.110928    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.110992    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.110962202 +0000 UTC m=+36.829407295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.111001    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:34.111100 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.111027    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.111021126 +0000 UTC m=+36.829466218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:34.211643 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.211524    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:34.211643 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:34.211591    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:34.212109 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.211685    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:34.212109 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.211759    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.211738305 +0000 UTC m=+36.930183397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:34.212109 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.211685    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:34.212109 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:34.211848    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:35.211827809 +0000 UTC m=+36.930272900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:35.021551 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.021501    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:35.021738 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.021613    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:35.021738 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.021691    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:35.021808 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.021769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.021749481 +0000 UTC m=+38.740194572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:35.021808 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.021779    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:35.021808 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.021802    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:35.021914 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.021860    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.02184551 +0000 UTC m=+38.740290609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.123330    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.123451    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.123529    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.123560    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.123897    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124004    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.123958066 +0000 UTC m=+38.842403157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124518    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124584    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.124566035 +0000 UTC m=+38.843011185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124647    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.124672072 +0000 UTC m=+38.843117162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:35.124816 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.124753    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.124742361 +0000 UTC m=+38.843187453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.225468    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.225752    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.225894    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.225964    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.225942111 +0000 UTC m=+38.944387205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.226218    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:35.226671 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:35.226273    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.226256164 +0000 UTC m=+38.944701258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:35.433397 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.433332    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dtz65"]
Jun 03 15:49:35.434675 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.434646    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"]
Jun 03 15:49:35.436696 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.436665    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln"]
Jun 03 15:49:35.441554 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.441526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a6673a_b8ef_4140_a086_ede4fb74aa17.slice/crio-3a5bd531b1d08354b262113e808b6cdb986a68e4462e9d3ffa819b8a9e46da87 WatchSource:0}: Error finding container 3a5bd531b1d08354b262113e808b6cdb986a68e4462e9d3ffa819b8a9e46da87: Status 404 returned error can't find the container with id 3a5bd531b1d08354b262113e808b6cdb986a68e4462e9d3ffa819b8a9e46da87
Jun 03 15:49:35.442278 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.442247    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3760a11a_7f92_4a32_b9a4_3b0f5cf816d1.slice/crio-172d7898296739718de0b04b0a373a92a37e2a53877a19dc6c735765ee8278c8 WatchSource:0}: Error finding container 172d7898296739718de0b04b0a373a92a37e2a53877a19dc6c735765ee8278c8: Status 404 returned error can't find the container with id 172d7898296739718de0b04b0a373a92a37e2a53877a19dc6c735765ee8278c8
Jun 03 15:49:35.443607 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.443543    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ca1d00_2cba_47bf_89f1_cb2a714c8b7f.slice/crio-6a2375572bce1f9f040fa2ece7be181f336b911f30f4ca416c562526b6743a4f WatchSource:0}: Error finding container 6a2375572bce1f9f040fa2ece7be181f336b911f30f4ca416c562526b6743a4f: Status 404 returned error can't find the container with id 6a2375572bce1f9f040fa2ece7be181f336b911f30f4ca416c562526b6743a4f
Jun 03 15:49:35.453660 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.453617    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5lrcg"]
Jun 03 15:49:35.455716 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.455562    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt"]
Jun 03 15:49:35.459883 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.459420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba055c2_fc0c_4473_abdc_ee2f24efa1d7.slice/crio-25014e5d34ddd4878bb183522eae2afad5452335eadbf927719a394f37592450 WatchSource:0}: Error finding container 25014e5d34ddd4878bb183522eae2afad5452335eadbf927719a394f37592450: Status 404 returned error can't find the container with id 25014e5d34ddd4878bb183522eae2afad5452335eadbf927719a394f37592450
Jun 03 15:49:35.461205 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.461187    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf"]
Jun 03 15:49:35.462578 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.462541    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4"]
Jun 03 15:49:35.466768 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.466596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b1f474_9ade_48e5_ba86_06e8f6668df9.slice/crio-6a49132d33e9f2d1869ba7fd4ae632c42eed70902cbac6298f749285d176705a WatchSource:0}: Error finding container 6a49132d33e9f2d1869ba7fd4ae632c42eed70902cbac6298f749285d176705a: Status 404 returned error can't find the container with id 6a49132d33e9f2d1869ba7fd4ae632c42eed70902cbac6298f749285d176705a
Jun 03 15:49:35.470129 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.469035    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod662ffcfa_ae06_4bfe_b8e9_72044ee26b02.slice/crio-daa8f25700b9bebad926ec86df97f9c9e5dc9788a8234e84344999991aa22eb8 WatchSource:0}: Error finding container daa8f25700b9bebad926ec86df97f9c9e5dc9788a8234e84344999991aa22eb8: Status 404 returned error can't find the container with id daa8f25700b9bebad926ec86df97f9c9e5dc9788a8234e84344999991aa22eb8
Jun 03 15:49:35.470627 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.470567    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-44fs6"]
Jun 03 15:49:35.471490 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.471372    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fae33f_e500_42a8_b32b_8ca4d5ec82ac.slice/crio-bcda502ebc10a28ea8b45667af2c4e484834dfe250935fe909d6d616d1fbbb12 WatchSource:0}: Error finding container bcda502ebc10a28ea8b45667af2c4e484834dfe250935fe909d6d616d1fbbb12: Status 404 returned error can't find the container with id bcda502ebc10a28ea8b45667af2c4e484834dfe250935fe909d6d616d1fbbb12
Jun 03 15:49:35.472366 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:49:35.471938    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod818bccad_ae01_414d_a772_f7e6ab770c68.slice/crio-847c8983331e729898ec1664475ebedc8ee09d0ac567d2f753ddb760a3d28faa WatchSource:0}: Error finding container 847c8983331e729898ec1664475ebedc8ee09d0ac567d2f753ddb760a3d28faa: Status 404 returned error can't find the container with id 847c8983331e729898ec1664475ebedc8ee09d0ac567d2f753ddb760a3d28faa
Jun 03 15:49:35.472366 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:35.472192    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"]
Jun 03 15:49:36.110575 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.110506    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6" event={"ID":"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac","Type":"ContainerStarted","Data":"bcda502ebc10a28ea8b45667af2c4e484834dfe250935fe909d6d616d1fbbb12"}
Jun 03 15:49:36.112798 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.112748    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4" event={"ID":"662ffcfa-ae06-4bfe-b8e9-72044ee26b02","Type":"ContainerStarted","Data":"daa8f25700b9bebad926ec86df97f9c9e5dc9788a8234e84344999991aa22eb8"}
Jun 03 15:49:36.114437 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.114372    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" event={"ID":"aba055c2-fc0c-4473-abdc-ee2f24efa1d7","Type":"ContainerStarted","Data":"25014e5d34ddd4878bb183522eae2afad5452335eadbf927719a394f37592450"}
Jun 03 15:49:36.117870 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.117795    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt" event={"ID":"d863496a-7e17-4cc8-99d8-5d13ee7d2de4","Type":"ContainerStarted","Data":"5e4103cecf468c8b5a4a1b65e9c1a3b8cc4b991203ed94e5e18771f8567191c2"}
Jun 03 15:49:36.119391 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.119335    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf" event={"ID":"57b1f474-9ade-48e5-ba86-06e8f6668df9","Type":"ContainerStarted","Data":"6a49132d33e9f2d1869ba7fd4ae632c42eed70902cbac6298f749285d176705a"}
Jun 03 15:49:36.123874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.122924    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="44956cfa946b2894fb47a7618bf810bd6bc296add4acaac608433c27d24e5657" exitCode=0
Jun 03 15:49:36.123874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.123010    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"44956cfa946b2894fb47a7618bf810bd6bc296add4acaac608433c27d24e5657"}
Jun 03 15:49:36.127204 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.127052    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerStarted","Data":"847c8983331e729898ec1664475ebedc8ee09d0ac567d2f753ddb760a3d28faa"}
Jun 03 15:49:36.135532 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.135439    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dtz65" event={"ID":"32a6673a-b8ef-4140-a086-ede4fb74aa17","Type":"ContainerStarted","Data":"3a5bd531b1d08354b262113e808b6cdb986a68e4462e9d3ffa819b8a9e46da87"}
Jun 03 15:49:36.137781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.137709    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6" event={"ID":"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1","Type":"ContainerStarted","Data":"172d7898296739718de0b04b0a373a92a37e2a53877a19dc6c735765ee8278c8"}
Jun 03 15:49:36.142216 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:36.142183    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln" event={"ID":"05ca1d00-2cba-47bf-89f1-cb2a714c8b7f","Type":"ContainerStarted","Data":"6a2375572bce1f9f040fa2ece7be181f336b911f30f4ca416c562526b6743a4f"}
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.063052    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.063219    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.063373    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.063389    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.063446    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.063427929 +0000 UTC m=+42.781873028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.063898    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:37.063997 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.063952    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.06393598 +0000 UTC m=+42.782381076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.163863    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.163951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.164005    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.164125    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.164314    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.164382    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.164362468 +0000 UTC m=+42.882807576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.164825    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.164874    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.164858415 +0000 UTC m=+42.883303507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.164941    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.16493008 +0000 UTC m=+42.883375171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.165014    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:37.165367 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.165041    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.165031695 +0000 UTC m=+42.883476787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:37.175461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.174413    2562 generic.go:358] "Generic (PLEG): container finished" podID="8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8" containerID="394b59f4dce79966835bb205c13b4a6f47f621595393fb4059deaecc383bc544" exitCode=0
Jun 03 15:49:37.175461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.174504    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerDied","Data":"394b59f4dce79966835bb205c13b4a6f47f621595393fb4059deaecc383bc544"}
Jun 03 15:49:37.266419 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.265488    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:37.266419 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:37.265616    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:37.266419 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.266174    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:37.266419 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.266237    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.266217297 +0000 UTC m=+42.984662393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:37.267071 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.266815    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:37.267071 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:37.266867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:41.266852275 +0000 UTC m=+42.985297379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:38.241289 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:38.240205    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-72gkk" event={"ID":"8238bcc6-33f7-4dcf-8dbf-dbc3d123b4d8","Type":"ContainerStarted","Data":"bb4800878d0836fea2482ccdcc2b2ac766c9aaddc922970416983bce902d930d"}
Jun 03 15:49:38.270446 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:38.269520    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-72gkk" podStartSLOduration=4.011753353 podStartE2EDuration="39.269500513s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:49:00.118131682 +0000 UTC m=+1.836576772" lastFinishedPulling="2026-06-03 15:49:35.375878826 +0000 UTC m=+37.094323932" observedRunningTime="2026-06-03 15:49:38.267808236 +0000 UTC m=+39.986253349" watchObservedRunningTime="2026-06-03 15:49:38.269500513 +0000 UTC m=+39.987945627"
Jun 03 15:49:41.113342 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.113296    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.113433    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.113453    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.113475    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.113540    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.113524335 +0000 UTC m=+50.831969434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.113574    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:41.113740 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.113654    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.113639348 +0000 UTC m=+50.832084450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:41.214536 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.214500    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:41.214714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.214574    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:41.214714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.214619    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:41.214714 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.214635    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:41.214714 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214683    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214732    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214751    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.214732211 +0000 UTC m=+50.933177303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214767    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.214760889 +0000 UTC m=+50.933205980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214791    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.214772792 +0000 UTC m=+50.933217885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214843    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:41.214922 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.214916    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.214899718 +0000 UTC m=+50.933344826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:41.315482 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.315432    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:41.315677 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:41.315518    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:41.315677 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.315606    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:41.315677 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.315667    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:41.315840 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.315691    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.315669318 +0000 UTC m=+51.034114422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:41.315840 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:41.315724    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:49.315707304 +0000 UTC m=+51.034152398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:49.191742 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.191695    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.191786    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.191853    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.191924    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.191942    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c8fb899d-z455c: secret "image-registry-tls" not found
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.191926    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.191910254 +0000 UTC m=+66.910355346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:49:49.192198 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.192021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls podName:9b73d258-1ba6-4410-b402-7267c8aa7d40 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.192004735 +0000 UTC m=+66.910449832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls") pod "image-registry-77c8fb899d-z455c" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40") : secret "image-registry-tls" not found
Jun 03 15:49:49.293032 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.292969    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:49:49.293197 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.293072    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:49.293197 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.293114    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:49:49.293197 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293127    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 15:49:49.293197 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.293132    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293196    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls podName:60f87a9a-7c7f-4922-802a-29cef828f6c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.293176519 +0000 UTC m=+67.011621612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-hvsjr" (UID: "60f87a9a-7c7f-4922-802a-29cef828f6c9") : secret "samples-operator-tls" not found
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293202    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293228    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293239    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.293224584 +0000 UTC m=+67.011669677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert podName:621e2760-8775-489e-afb5-d3fcbe7f74cd nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.293253384 +0000 UTC m=+67.011698476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert") pod "ingress-canary-4zmt8" (UID: "621e2760-8775-489e-afb5-d3fcbe7f74cd") : secret "canary-serving-cert" not found
Jun 03 15:49:49.293364 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.293280    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.293274906 +0000 UTC m=+67.011719997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : secret "router-metrics-certs-default" not found
Jun 03 15:49:49.394002 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.393934    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:49:49.394201 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:49.394067    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:49:49.394201 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.394099    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 15:49:49.394201 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.394161    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls podName:a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.394147059 +0000 UTC m=+67.112592151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls") pod "dns-default-2r64w" (UID: "a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8") : secret "dns-default-metrics-tls" not found
Jun 03 15:49:49.394378 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.394255    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:49:49.394378 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:49.394332    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:05.39431248 +0000 UTC m=+67.112757574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:49:50.269728 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.269687    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6" event={"ID":"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac","Type":"ContainerStarted","Data":"01d59c6ab9108252830f0239bddfbd09e5679fd0c9ef8863235845456212feae"}
Jun 03 15:49:50.271453 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.271413    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4" event={"ID":"662ffcfa-ae06-4bfe-b8e9-72044ee26b02","Type":"ContainerStarted","Data":"502016132f1966b87dcc223e6d6fea1f5ac88a73f0d63c1a3d01fb099f576549"}
Jun 03 15:49:50.272912 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.272885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/0.log"
Jun 03 15:49:50.273063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.272929    2562 generic.go:358] "Generic (PLEG): container finished" podID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7" containerID="46998f9129e5fdcf4b1c74ed00c96ab668c5a6ad2b5749e7b13e38700dc243a5" exitCode=255
Jun 03 15:49:50.273063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.273022    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" event={"ID":"aba055c2-fc0c-4473-abdc-ee2f24efa1d7","Type":"ContainerDied","Data":"46998f9129e5fdcf4b1c74ed00c96ab668c5a6ad2b5749e7b13e38700dc243a5"}
Jun 03 15:49:50.273265 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.273243    2562 scope.go:117] "RemoveContainer" containerID="46998f9129e5fdcf4b1c74ed00c96ab668c5a6ad2b5749e7b13e38700dc243a5"
Jun 03 15:49:50.275108 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.275072    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt" event={"ID":"d863496a-7e17-4cc8-99d8-5d13ee7d2de4","Type":"ContainerStarted","Data":"2558f1ad947b60a0729168f7b170ab7120ee8037a4276df0999ecc29d9f4ddc3"}
Jun 03 15:49:50.277049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.277026    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf" event={"ID":"57b1f474-9ade-48e5-ba86-06e8f6668df9","Type":"ContainerStarted","Data":"202b83dc842ba32503d6548737bf7d6ac72d1dd55387a66e7fe9cc073e184cb7"}
Jun 03 15:49:50.278461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.278438    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerStarted","Data":"ced79b0f6a3c14b30f47c71ce63447d59e1fa8d0dfe0d0ea59e93fa458b0d9fa"}
Jun 03 15:49:50.279815 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.279791    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dtz65" event={"ID":"32a6673a-b8ef-4140-a086-ede4fb74aa17","Type":"ContainerStarted","Data":"0ed9f9f419e3600d3bfda3d3d8c82b8a577319c858d3ab3f4079db71b6f91fba"}
Jun 03 15:49:50.281535 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.281511    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6" event={"ID":"3760a11a-7f92-4a32-b9a4-3b0f5cf816d1","Type":"ContainerStarted","Data":"1ce6e45318deac8bea0a2bf2638a27acb2eb53f51d8f4295d42e885c6abd1c89"}
Jun 03 15:49:50.282235 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.281927    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:50.283148 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.283124    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln" event={"ID":"05ca1d00-2cba-47bf-89f1-cb2a714c8b7f","Type":"ContainerStarted","Data":"cb5aa8300f7307c1c1a30a7f80381dd9e882ef8df31262873604cebd7bb83741"}
Jun 03 15:49:50.283730 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.283703    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6"
Jun 03 15:49:50.289915 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.289863    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6" podStartSLOduration=29.289713122 podStartE2EDuration="43.289846212s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.473186824 +0000 UTC m=+37.191631933" lastFinishedPulling="2026-06-03 15:49:49.473319932 +0000 UTC m=+51.191765023" observedRunningTime="2026-06-03 15:49:50.288434981 +0000 UTC m=+52.006880097" watchObservedRunningTime="2026-06-03 15:49:50.289846212 +0000 UTC m=+52.008291327"
Jun 03 15:49:50.334950 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.334867    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d494fbfb8-7j8n4" podStartSLOduration=24.280226279 podStartE2EDuration="38.334846416s" podCreationTimestamp="2026-06-03 15:49:12 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.472100816 +0000 UTC m=+37.190545907" lastFinishedPulling="2026-06-03 15:49:49.526720933 +0000 UTC m=+51.245166044" observedRunningTime="2026-06-03 15:49:50.30824044 +0000 UTC m=+52.026685556" watchObservedRunningTime="2026-06-03 15:49:50.334846416 +0000 UTC m=+52.053291532"
Jun 03 15:49:50.372346 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.372284    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-svcln" podStartSLOduration=29.344728408 podStartE2EDuration="43.372265413s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.445784634 +0000 UTC m=+37.164229725" lastFinishedPulling="2026-06-03 15:49:49.473321638 +0000 UTC m=+51.191766730" observedRunningTime="2026-06-03 15:49:50.352333829 +0000 UTC m=+52.070778943" watchObservedRunningTime="2026-06-03 15:49:50.372265413 +0000 UTC m=+52.090710527"
Jun 03 15:49:50.373181 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.373147    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt" podStartSLOduration=29.362283808 podStartE2EDuration="43.373137006s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.462465216 +0000 UTC m=+37.180910321" lastFinishedPulling="2026-06-03 15:49:49.473318422 +0000 UTC m=+51.191763519" observedRunningTime="2026-06-03 15:49:50.371847039 +0000 UTC m=+52.090292152" watchObservedRunningTime="2026-06-03 15:49:50.373137006 +0000 UTC m=+52.091582165"
Jun 03 15:49:50.425090 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.420208    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-dtz65" podStartSLOduration=29.365246104 podStartE2EDuration="43.420188457s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.444048246 +0000 UTC m=+37.162493337" lastFinishedPulling="2026-06-03 15:49:49.498990585 +0000 UTC m=+51.217435690" observedRunningTime="2026-06-03 15:49:50.418513452 +0000 UTC m=+52.136958567" watchObservedRunningTime="2026-06-03 15:49:50.420188457 +0000 UTC m=+52.138633570"
Jun 03 15:49:50.425090 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.421584    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-z6hcf" podStartSLOduration=29.364918768 podStartE2EDuration="43.421569857s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.471443036 +0000 UTC m=+37.189888127" lastFinishedPulling="2026-06-03 15:49:49.528094122 +0000 UTC m=+51.246539216" observedRunningTime="2026-06-03 15:49:50.392166808 +0000 UTC m=+52.110611915" watchObservedRunningTime="2026-06-03 15:49:50.421569857 +0000 UTC m=+52.140014974"
Jun 03 15:49:50.439365 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:50.439292    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dfc87bd9f-lzzt6" podStartSLOduration=24.356775568 podStartE2EDuration="38.439272593s" podCreationTimestamp="2026-06-03 15:49:12 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.44422552 +0000 UTC m=+37.162670615" lastFinishedPulling="2026-06-03 15:49:49.526722547 +0000 UTC m=+51.245167640" observedRunningTime="2026-06-03 15:49:50.434945867 +0000 UTC m=+52.153390981" watchObservedRunningTime="2026-06-03 15:49:50.439272593 +0000 UTC m=+52.157717707"
Jun 03 15:49:51.287907 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.287875    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/1.log"
Jun 03 15:49:51.288425 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.288313    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/0.log"
Jun 03 15:49:51.288425 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.288342    2562 generic.go:358] "Generic (PLEG): container finished" podID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55" exitCode=255
Jun 03 15:49:51.289681 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.289427    2562 scope.go:117] "RemoveContainer" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"
Jun 03 15:49:51.289681 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:51.289575    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:49:51.289681 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.289612    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" event={"ID":"aba055c2-fc0c-4473-abdc-ee2f24efa1d7","Type":"ContainerDied","Data":"1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"}
Jun 03 15:49:51.289681 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:51.289649    2562 scope.go:117] "RemoveContainer" containerID="46998f9129e5fdcf4b1c74ed00c96ab668c5a6ad2b5749e7b13e38700dc243a5"
Jun 03 15:49:52.295659 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:52.295629    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/1.log"
Jun 03 15:49:52.296165 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:52.296094    2562 scope.go:117] "RemoveContainer" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"
Jun 03 15:49:52.296280 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:52.296262    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:49:53.300443 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.300404    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerStarted","Data":"238241e00686d1a994a8fbc579a5b10049d089539557b6af23d76ab07fa49cac"}
Jun 03 15:49:53.300443 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.300445    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerStarted","Data":"52ec811bed9efbbbfcd6b836ee14e74b30c7246249be54612e02289f055a54f1"}
Jun 03 15:49:53.328829 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.328769    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" podStartSLOduration=24.482579268 podStartE2EDuration="41.328753267s" podCreationTimestamp="2026-06-03 15:49:12 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.474285582 +0000 UTC m=+37.192730674" lastFinishedPulling="2026-06-03 15:49:52.320459569 +0000 UTC m=+54.038904673" observedRunningTime="2026-06-03 15:49:53.328112799 +0000 UTC m=+55.046557911" watchObservedRunningTime="2026-06-03 15:49:53.328753267 +0000 UTC m=+55.047198380"
Jun 03 15:49:53.624432 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.624388    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:53.624432 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.624430    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:49:53.624868 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:53.624850    2562 scope.go:117] "RemoveContainer" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"
Jun 03 15:49:53.628573 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:49:53.625541    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:49:54.520918 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:54.520888    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5p74_311562ad-9379-4db5-9c0e-90fdef2313cf/dns-node-resolver/0.log"
Jun 03 15:49:55.120770 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:55.120737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g5f5h_a74849aa-ac32-4d0f-b356-0e2346d8afad/node-ca/0.log"
Jun 03 15:49:56.922707 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:49:56.922670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-zjlxt_d863496a-7e17-4cc8-99d8-5d13ee7d2de4/kube-storage-version-migrator-operator/0.log"
Jun 03 15:50:00.107109 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:00.107073    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jlgn5"
Jun 03 15:50:03.534524 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.534473    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:50:03.537882 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.537858    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 15:50:03.544828 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:03.544805    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 15:50:03.544889 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:03.544874    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs podName:2c0300be-0c52-4fcf-a35f-eb646dafd23e nodeName:}" failed. No retries permitted until 2026-06-03 15:51:07.544852046 +0000 UTC m=+129.263297138 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs") pod "network-metrics-daemon-p8n47" (UID: "2c0300be-0c52-4fcf-a35f-eb646dafd23e") : secret "metrics-daemon-secret" not found
Jun 03 15:50:03.635648 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.635601    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:50:03.639650 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.639616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jcpn\" (UniqueName: \"kubernetes.io/projected/13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0-kube-api-access-9jcpn\") pod \"network-check-target-hvdxf\" (UID: \"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0\") " pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:50:03.848686 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.848654    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\""
Jun 03 15:50:03.857049 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.857013    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:50:03.995566 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:03.995528    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvdxf"]
Jun 03 15:50:03.998811 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:03.998772    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fc7bb5_0b31_4f4f_904b_8efc2f8cb3a0.slice/crio-2893dce369d276d50ad6da072255dcc8ed10d17b920eabbf43a2a07c651bead2 WatchSource:0}: Error finding container 2893dce369d276d50ad6da072255dcc8ed10d17b920eabbf43a2a07c651bead2: Status 404 returned error can't find the container with id 2893dce369d276d50ad6da072255dcc8ed10d17b920eabbf43a2a07c651bead2
Jun 03 15:50:04.333450 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.333361    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvdxf" event={"ID":"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0","Type":"ContainerStarted","Data":"38f7492e2eaedf7cfddbd1c4f4ab8fbdaf8a41bb1b183a9093737baa49423ea2"}
Jun 03 15:50:04.333450 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.333405    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvdxf" event={"ID":"13fc7bb5-0b31-4f4f-904b-8efc2f8cb3a0","Type":"ContainerStarted","Data":"2893dce369d276d50ad6da072255dcc8ed10d17b920eabbf43a2a07c651bead2"}
Jun 03 15:50:04.333657 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.333499    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:50:04.363381 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.363323    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hvdxf" podStartSLOduration=65.363306202 podStartE2EDuration="1m5.363306202s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:50:04.362327731 +0000 UTC m=+66.080772845" watchObservedRunningTime="2026-06-03 15:50:04.363306202 +0000 UTC m=+66.081751314"
Jun 03 15:50:04.444246 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.444208    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:50:04.446854 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.446831    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 15:50:04.457642 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.457612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d159f76a-351c-4709-a7b5-657fd5529ac0-original-pull-secret\") pod \"global-pull-secret-syncer-79fhh\" (UID: \"d159f76a-351c-4709-a7b5-657fd5529ac0\") " pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:50:04.731283 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.731239    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-79fhh"
Jun 03 15:50:04.877747 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:04.877647    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-79fhh"]
Jun 03 15:50:04.880195 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:04.880151    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd159f76a_351c_4709_a7b5_657fd5529ac0.slice/crio-33c7668af23ea651463eb180ab91fe5df0dc536f18840dd83b66d5232f998548 WatchSource:0}: Error finding container 33c7668af23ea651463eb180ab91fe5df0dc536f18840dd83b66d5232f998548: Status 404 returned error can't find the container with id 33c7668af23ea651463eb180ab91fe5df0dc536f18840dd83b66d5232f998548
Jun 03 15:50:05.251905 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.251858    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:50:05.252117 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.251943    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:50:05.252117 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:05.252093    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 15:50:05.252192 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:05.252161    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls podName:1dbd68ca-2505-4ac4-a44e-74c13b9a356f nodeName:}" failed. No retries permitted until 2026-06-03 15:50:37.252143299 +0000 UTC m=+98.970588391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-f5q85" (UID: "1dbd68ca-2505-4ac4-a44e-74c13b9a356f") : secret "cluster-monitoring-operator-tls" not found
Jun 03 15:50:05.254611 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.254587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"image-registry-77c8fb899d-z455c\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") " pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:50:05.336994 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.336930    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-79fhh" event={"ID":"d159f76a-351c-4709-a7b5-657fd5529ac0","Type":"ContainerStarted","Data":"33c7668af23ea651463eb180ab91fe5df0dc536f18840dd83b66d5232f998548"}
Jun 03 15:50:05.352814 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.352771    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:05.353040 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.352838    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:05.353040 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.352863    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:50:05.353040 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.352951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:50:05.353223 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:05.353049    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle podName:10798e32-9ffa-44ed-a408-c2ff6e562dd0 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:37.353028338 +0000 UTC m=+99.071473430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle") pod "router-default-595576bf8c-cp6dz" (UID: "10798e32-9ffa-44ed-a408-c2ff6e562dd0") : configmap references non-existent config key: service-ca.crt
Jun 03 15:50:05.355501 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.355464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10798e32-9ffa-44ed-a408-c2ff6e562dd0-metrics-certs\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:05.355501 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.355487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/60f87a9a-7c7f-4922-802a-29cef828f6c9-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-hvsjr\" (UID: \"60f87a9a-7c7f-4922-802a-29cef828f6c9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:50:05.355667 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.355541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/621e2760-8775-489e-afb5-d3fcbe7f74cd-cert\") pod \"ingress-canary-4zmt8\" (UID: \"621e2760-8775-489e-afb5-d3fcbe7f74cd\") " pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:50:05.432903 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.432865    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q22fp\""
Jun 03 15:50:05.440261 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.440235    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:50:05.443162 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.443140    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qjgb7\""
Jun 03 15:50:05.451359 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.451330    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"
Jun 03 15:50:05.454544 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.454510    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:50:05.454695 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.454610    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:50:05.454769 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:05.454748    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 15:50:05.454837 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:05.454825    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert podName:4e3dd312-b361-41d0-aca5-dbc75fd21d16 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:37.454810844 +0000 UTC m=+99.173255934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-xqsq2" (UID: "4e3dd312-b361-41d0-aca5-dbc75fd21d16") : secret "networking-console-plugin-cert" not found
Jun 03 15:50:05.457150 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.457123    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8-metrics-tls\") pod \"dns-default-2r64w\" (UID: \"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8\") " pod="openshift-dns/dns-default-2r64w"
Jun 03 15:50:05.489299 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.489267    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\""
Jun 03 15:50:05.496684 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.496599    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4zmt8"
Jun 03 15:50:05.632400 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.632369    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\""
Jun 03 15:50:05.634151 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.633553    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:50:05.637606 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:05.637565    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b73d258_1ba6_4410_b402_7267c8aa7d40.slice/crio-76ac12bdf02182e258b18f0e6fa9a69e08ea0d611b5fa1c588444ac08a09d661 WatchSource:0}: Error finding container 76ac12bdf02182e258b18f0e6fa9a69e08ea0d611b5fa1c588444ac08a09d661: Status 404 returned error can't find the container with id 76ac12bdf02182e258b18f0e6fa9a69e08ea0d611b5fa1c588444ac08a09d661
Jun 03 15:50:05.640278 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.639913    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2r64w"
Jun 03 15:50:05.651546 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.651497    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr"]
Jun 03 15:50:05.701347 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.701311    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4zmt8"]
Jun 03 15:50:05.813652 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:05.813598    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2r64w"]
Jun 03 15:50:05.817042 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:05.816999    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda549d3a0_7fdb_4612_9f5d_5879bcc1b3b8.slice/crio-b48544e3438830a048b359c985d0186a6e1f8522de89b1a25eb50234b00bf892 WatchSource:0}: Error finding container b48544e3438830a048b359c985d0186a6e1f8522de89b1a25eb50234b00bf892: Status 404 returned error can't find the container with id b48544e3438830a048b359c985d0186a6e1f8522de89b1a25eb50234b00bf892
Jun 03 15:50:06.343369 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.343328    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" event={"ID":"9b73d258-1ba6-4410-b402-7267c8aa7d40","Type":"ContainerStarted","Data":"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"}
Jun 03 15:50:06.343369 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.343371    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" event={"ID":"9b73d258-1ba6-4410-b402-7267c8aa7d40","Type":"ContainerStarted","Data":"76ac12bdf02182e258b18f0e6fa9a69e08ea0d611b5fa1c588444ac08a09d661"}
Jun 03 15:50:06.343626 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.343407    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:50:06.345493 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.345442    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr" event={"ID":"60f87a9a-7c7f-4922-802a-29cef828f6c9","Type":"ContainerStarted","Data":"3c03fddfc03870e93b5b9fb82d9923a044631fffbc839fd528f5c6e1980443b3"}
Jun 03 15:50:06.347040 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.347006    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4zmt8" event={"ID":"621e2760-8775-489e-afb5-d3fcbe7f74cd","Type":"ContainerStarted","Data":"9a7added56d487189f107aac6a9a6c6d1c6e75e0e285ed076d32e5c312cc6ac5"}
Jun 03 15:50:06.349113 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:06.349057    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r64w" event={"ID":"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8","Type":"ContainerStarted","Data":"b48544e3438830a048b359c985d0186a6e1f8522de89b1a25eb50234b00bf892"}
Jun 03 15:50:08.820819 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:08.820787    2562 scope.go:117] "RemoveContainer" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"
Jun 03 15:50:08.852788 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:08.852736    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" podStartSLOduration=69.852720991 podStartE2EDuration="1m9.852720991s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:50:06.372355354 +0000 UTC m=+68.090800460" watchObservedRunningTime="2026-06-03 15:50:08.852720991 +0000 UTC m=+70.571166104"
Jun 03 15:50:08.991560 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:08.990250    2562 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba055c2_fc0c_4473_abdc_ee2f24efa1d7.slice/crio-c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4.scope\": RecentStats: unable to find data in memory cache]"
Jun 03 15:50:09.361711 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.361681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:50:09.362189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.362158    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/1.log"
Jun 03 15:50:09.362329 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.362203    2562 generic.go:358] "Generic (PLEG): container finished" podID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7" containerID="c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4" exitCode=255
Jun 03 15:50:09.362329 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.362276    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" event={"ID":"aba055c2-fc0c-4473-abdc-ee2f24efa1d7","Type":"ContainerDied","Data":"c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4"}
Jun 03 15:50:09.362329 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.362312    2562 scope.go:117] "RemoveContainer" containerID="1522185d91c150cb5386be87c5a0def54b88a34423b812fb54b96c09c0a42c55"
Jun 03 15:50:09.362756 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.362715    2562 scope.go:117] "RemoveContainer" containerID="c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4"
Jun 03 15:50:09.362955 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:09.362933    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:50:09.364839 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.364809    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr" event={"ID":"60f87a9a-7c7f-4922-802a-29cef828f6c9","Type":"ContainerStarted","Data":"d410452fb64d70c467dbe5202c654e68017d8e2ddd0fb2d3964754811111d64e"}
Jun 03 15:50:09.364964 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.364846    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr" event={"ID":"60f87a9a-7c7f-4922-802a-29cef828f6c9","Type":"ContainerStarted","Data":"d085a14a5994a600b80e9e53ab0d23ad42ee1a9a8a9a4dc3761e7e21346bef85"}
Jun 03 15:50:09.366509 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.366486    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4zmt8" event={"ID":"621e2760-8775-489e-afb5-d3fcbe7f74cd","Type":"ContainerStarted","Data":"7f2a9f438ce288febf5f15c2d6649bc713d5992d3bb6602b6ee04111b48cbea4"}
Jun 03 15:50:09.368306 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.368284    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r64w" event={"ID":"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8","Type":"ContainerStarted","Data":"f4156f0bd5a792109ce2ae34e1d9555822aa12dfe22d8235b446e6656f23170a"}
Jun 03 15:50:09.368407 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.368314    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2r64w" event={"ID":"a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8","Type":"ContainerStarted","Data":"00e2c1636aed60f42751cd6d5c062d7e9ce9a39e63bc43a364e65fb3fb900d74"}
Jun 03 15:50:09.368473 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.368429    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2r64w"
Jun 03 15:50:09.441607 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.441542    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4zmt8" podStartSLOduration=33.372380374 podStartE2EDuration="36.441522121s" podCreationTimestamp="2026-06-03 15:49:33 +0000 UTC" firstStartedPulling="2026-06-03 15:50:05.713320992 +0000 UTC m=+67.431766082" lastFinishedPulling="2026-06-03 15:50:08.782462727 +0000 UTC m=+70.500907829" observedRunningTime="2026-06-03 15:50:09.440678707 +0000 UTC m=+71.159123820" watchObservedRunningTime="2026-06-03 15:50:09.441522121 +0000 UTC m=+71.159967237"
Jun 03 15:50:09.467131 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.467059    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2r64w" podStartSLOduration=33.510070059 podStartE2EDuration="36.467038061s" podCreationTimestamp="2026-06-03 15:49:33 +0000 UTC" firstStartedPulling="2026-06-03 15:50:05.819416321 +0000 UTC m=+67.537861411" lastFinishedPulling="2026-06-03 15:50:08.776384319 +0000 UTC m=+70.494829413" observedRunningTime="2026-06-03 15:50:09.464583423 +0000 UTC m=+71.183028558" watchObservedRunningTime="2026-06-03 15:50:09.467038061 +0000 UTC m=+71.185483171"
Jun 03 15:50:09.496617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:09.496564    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-hvsjr" podStartSLOduration=59.479374338 podStartE2EDuration="1m2.496545157s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:50:05.761756005 +0000 UTC m=+67.480201099" lastFinishedPulling="2026-06-03 15:50:08.778926814 +0000 UTC m=+70.497371918" observedRunningTime="2026-06-03 15:50:09.495476862 +0000 UTC m=+71.213921977" watchObservedRunningTime="2026-06-03 15:50:09.496545157 +0000 UTC m=+71.214990273"
Jun 03 15:50:11.377150 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:11.377118    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:50:11.378420 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:11.378388    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-79fhh" event={"ID":"d159f76a-351c-4709-a7b5-657fd5529ac0","Type":"ContainerStarted","Data":"e474077587cfe64e5a0c3444f69b96a1f5b5794736a2f941defa808724be4dc6"}
Jun 03 15:50:11.410267 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:11.410213    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-79fhh" podStartSLOduration=65.840009291 podStartE2EDuration="1m11.410196029s" podCreationTimestamp="2026-06-03 15:49:00 +0000 UTC" firstStartedPulling="2026-06-03 15:50:04.882034171 +0000 UTC m=+66.600479263" lastFinishedPulling="2026-06-03 15:50:10.452220909 +0000 UTC m=+72.170666001" observedRunningTime="2026-06-03 15:50:11.408157178 +0000 UTC m=+73.126602292" watchObservedRunningTime="2026-06-03 15:50:11.410196029 +0000 UTC m=+73.128641142"
Jun 03 15:50:13.624479 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:13.624438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:50:13.624479 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:13.624476    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:50:13.625015 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:13.624844    2562 scope.go:117] "RemoveContainer" containerID="c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4"
Jun 03 15:50:13.625091 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:13.625068    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:50:17.477145 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.477104    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qvj8j"]
Jun 03 15:50:17.516988 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.516938    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qvj8j"]
Jun 03 15:50:17.517155 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.517133    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.521098 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.521069    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 15:50:17.523434 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.523403    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5dkg\""
Jun 03 15:50:17.523638 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.523554    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 15:50:17.565270 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.565228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc1724a7-de7b-40e9-a5a6-20b8c574258c-data-volume\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.565442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.565285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmj2k\" (UniqueName: \"kubernetes.io/projected/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-api-access-rmj2k\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.565442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.565320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc1724a7-de7b-40e9-a5a6-20b8c574258c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.565442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.565375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.565442 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.565394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc1724a7-de7b-40e9-a5a6-20b8c574258c-crio-socket\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666160 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666118    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc1724a7-de7b-40e9-a5a6-20b8c574258c-data-volume\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666335 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666183    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmj2k\" (UniqueName: \"kubernetes.io/projected/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-api-access-rmj2k\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666335 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666228    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc1724a7-de7b-40e9-a5a6-20b8c574258c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666335 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666335 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666288    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc1724a7-de7b-40e9-a5a6-20b8c574258c-crio-socket\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666524 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc1724a7-de7b-40e9-a5a6-20b8c574258c-crio-socket\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666564 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc1724a7-de7b-40e9-a5a6-20b8c574258c-data-volume\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.666790 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.666759    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.668780 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.668760    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc1724a7-de7b-40e9-a5a6-20b8c574258c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.677550 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.677524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmj2k\" (UniqueName: \"kubernetes.io/projected/fc1724a7-de7b-40e9-a5a6-20b8c574258c-kube-api-access-rmj2k\") pod \"insights-runtime-extractor-qvj8j\" (UID: \"fc1724a7-de7b-40e9-a5a6-20b8c574258c\") " pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:17.826626 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:17.826543    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qvj8j"
Jun 03 15:50:18.006750 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:18.006679    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qvj8j"]
Jun 03 15:50:18.010640 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:18.010597    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1724a7_de7b_40e9_a5a6_20b8c574258c.slice/crio-13c80fb432a2c84ea55d0d7f6044fc22781522564692d61bbb527a8b3a76c219 WatchSource:0}: Error finding container 13c80fb432a2c84ea55d0d7f6044fc22781522564692d61bbb527a8b3a76c219: Status 404 returned error can't find the container with id 13c80fb432a2c84ea55d0d7f6044fc22781522564692d61bbb527a8b3a76c219
Jun 03 15:50:18.398803 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:18.398769    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvj8j" event={"ID":"fc1724a7-de7b-40e9-a5a6-20b8c574258c","Type":"ContainerStarted","Data":"fe6b2efa961f45a54ff6cc154c22535d92a4e3644251cb518e3749c1469aa638"}
Jun 03 15:50:18.398803 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:18.398807    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvj8j" event={"ID":"fc1724a7-de7b-40e9-a5a6-20b8c574258c","Type":"ContainerStarted","Data":"13c80fb432a2c84ea55d0d7f6044fc22781522564692d61bbb527a8b3a76c219"}
Jun 03 15:50:19.375492 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:19.375460    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2r64w"
Jun 03 15:50:19.403731 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:19.403693    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvj8j" event={"ID":"fc1724a7-de7b-40e9-a5a6-20b8c574258c","Type":"ContainerStarted","Data":"603e310f20fb48fd379838cb910c6cfc5a28314792fe3a0ea8ed8f7f90fa520e"}
Jun 03 15:50:21.412208 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:21.412171    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvj8j" event={"ID":"fc1724a7-de7b-40e9-a5a6-20b8c574258c","Type":"ContainerStarted","Data":"fe1059b2f355e57f121a5fc44fff76c1ccdc686799f9fe9a5f43fa854622ebb1"}
Jun 03 15:50:21.435657 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:21.435601    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qvj8j" podStartSLOduration=1.5659753090000001 podStartE2EDuration="4.435585769s" podCreationTimestamp="2026-06-03 15:50:17 +0000 UTC" firstStartedPulling="2026-06-03 15:50:18.143261944 +0000 UTC m=+79.861707036" lastFinishedPulling="2026-06-03 15:50:21.012872396 +0000 UTC m=+82.731317496" observedRunningTime="2026-06-03 15:50:21.434006435 +0000 UTC m=+83.152451548" watchObservedRunningTime="2026-06-03 15:50:21.435585769 +0000 UTC m=+83.154030879"
Jun 03 15:50:25.445075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:25.445040    2562 patch_prober.go:28] interesting pod/image-registry-77c8fb899d-z455c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 15:50:25.445449 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:25.445102    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 15:50:27.358148 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:27.358113    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:50:27.820778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:27.820691    2562 scope.go:117] "RemoveContainer" containerID="c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4"
Jun 03 15:50:27.820927 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:50:27.820872    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5lrcg_openshift-console-operator(aba055c2-fc0c-4473-abdc-ee2f24efa1d7)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podUID="aba055c2-fc0c-4473-abdc-ee2f24efa1d7"
Jun 03 15:50:35.339881 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:35.339844    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hvdxf"
Jun 03 15:50:37.341844 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.341798    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:50:37.344390 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.344368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbd68ca-2505-4ac4-a44e-74c13b9a356f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-f5q85\" (UID: \"1dbd68ca-2505-4ac4-a44e-74c13b9a356f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:50:37.442295 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.442246    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:37.442941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.442919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10798e32-9ffa-44ed-a408-c2ff6e562dd0-service-ca-bundle\") pod \"router-default-595576bf8c-cp6dz\" (UID: \"10798e32-9ffa-44ed-a408-c2ff6e562dd0\") " pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:37.487273 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.487235    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9q8sr\""
Jun 03 15:50:37.495522 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.495489    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"
Jun 03 15:50:37.542793 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.542744    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:50:37.546652 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.546546    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e3dd312-b361-41d0-aca5-dbc75fd21d16-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-xqsq2\" (UID: \"4e3dd312-b361-41d0-aca5-dbc75fd21d16\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:50:37.560533 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.560414    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nqcnz\""
Jun 03 15:50:37.568100 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.568040    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:37.643875 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.643143    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k7x8c\""
Jun 03 15:50:37.644620 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.644569    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85"]
Jun 03 15:50:37.648801 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:37.648757    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbd68ca_2505_4ac4_a44e_74c13b9a356f.slice/crio-5746bd68de2447ff6b1e1b18f3547fe31c30104a0ef95531652f0169033aa518 WatchSource:0}: Error finding container 5746bd68de2447ff6b1e1b18f3547fe31c30104a0ef95531652f0169033aa518: Status 404 returned error can't find the container with id 5746bd68de2447ff6b1e1b18f3547fe31c30104a0ef95531652f0169033aa518
Jun 03 15:50:37.649609 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.649574    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"
Jun 03 15:50:37.723897 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.723865    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-595576bf8c-cp6dz"]
Jun 03 15:50:37.728387 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:37.728353    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10798e32_9ffa_44ed_a408_c2ff6e562dd0.slice/crio-63a8dd301d0b93aea9bf2ebe540eb2d5c3915af093262fa36a44a73b1a58be3d WatchSource:0}: Error finding container 63a8dd301d0b93aea9bf2ebe540eb2d5c3915af093262fa36a44a73b1a58be3d: Status 404 returned error can't find the container with id 63a8dd301d0b93aea9bf2ebe540eb2d5c3915af093262fa36a44a73b1a58be3d
Jun 03 15:50:37.809674 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:37.809489    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2"]
Jun 03 15:50:37.812966 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:37.812926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3dd312_b361_41d0_aca5_dbc75fd21d16.slice/crio-bce1cc13983fb2ca5e50dc4bffacbdb833f3d2badcd77ed45725875c68220d3d WatchSource:0}: Error finding container bce1cc13983fb2ca5e50dc4bffacbdb833f3d2badcd77ed45725875c68220d3d: Status 404 returned error can't find the container with id bce1cc13983fb2ca5e50dc4bffacbdb833f3d2badcd77ed45725875c68220d3d
Jun 03 15:50:38.457574 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.457528    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85" event={"ID":"1dbd68ca-2505-4ac4-a44e-74c13b9a356f","Type":"ContainerStarted","Data":"5746bd68de2447ff6b1e1b18f3547fe31c30104a0ef95531652f0169033aa518"}
Jun 03 15:50:38.458787 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.458749    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2" event={"ID":"4e3dd312-b361-41d0-aca5-dbc75fd21d16","Type":"ContainerStarted","Data":"bce1cc13983fb2ca5e50dc4bffacbdb833f3d2badcd77ed45725875c68220d3d"}
Jun 03 15:50:38.460134 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.460103    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-595576bf8c-cp6dz" event={"ID":"10798e32-9ffa-44ed-a408-c2ff6e562dd0","Type":"ContainerStarted","Data":"eb93a7a0d9d8900c0264c4f1475c84bef5a37cbb6553b7a2d3998b26e326f593"}
Jun 03 15:50:38.460134 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.460137    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-595576bf8c-cp6dz" event={"ID":"10798e32-9ffa-44ed-a408-c2ff6e562dd0","Type":"ContainerStarted","Data":"63a8dd301d0b93aea9bf2ebe540eb2d5c3915af093262fa36a44a73b1a58be3d"}
Jun 03 15:50:38.569136 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.569099    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:38.572258 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.572225    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:38.604294 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:38.604225    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-595576bf8c-cp6dz" podStartSLOduration=91.604203656 podStartE2EDuration="1m31.604203656s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:50:38.494884734 +0000 UTC m=+100.213329847" watchObservedRunningTime="2026-06-03 15:50:38.604203656 +0000 UTC m=+100.322648770"
Jun 03 15:50:39.465171 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:39.465041    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2" event={"ID":"4e3dd312-b361-41d0-aca5-dbc75fd21d16","Type":"ContainerStarted","Data":"41bc69b99801550942b8bb9549345b02281e87b07d4027ea96f1f0b8629862dc"}
Jun 03 15:50:39.465171 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:39.465143    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:39.466700 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:39.466675    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-595576bf8c-cp6dz"
Jun 03 15:50:39.505784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:39.505714    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-xqsq2" podStartSLOduration=67.165773322 podStartE2EDuration="1m8.5056951s" podCreationTimestamp="2026-06-03 15:49:31 +0000 UTC" firstStartedPulling="2026-06-03 15:50:37.814910651 +0000 UTC m=+99.533355744" lastFinishedPulling="2026-06-03 15:50:39.154832429 +0000 UTC m=+100.873277522" observedRunningTime="2026-06-03 15:50:39.504563549 +0000 UTC m=+101.223008663" watchObservedRunningTime="2026-06-03 15:50:39.5056951 +0000 UTC m=+101.224140214"
Jun 03 15:50:39.792540 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:39.792508    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:50:40.469443 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:40.469406    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85" event={"ID":"1dbd68ca-2505-4ac4-a44e-74c13b9a356f","Type":"ContainerStarted","Data":"ca1d3468cee9a353fdb833da2f0bf782426555b2a84d3f4542a3a5c7e37df16e"}
Jun 03 15:50:40.496971 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:40.496914    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-f5q85" podStartSLOduration=91.378465083 podStartE2EDuration="1m33.496895995s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:50:37.650834343 +0000 UTC m=+99.369279434" lastFinishedPulling="2026-06-03 15:50:39.769265243 +0000 UTC m=+101.487710346" observedRunningTime="2026-06-03 15:50:40.495088459 +0000 UTC m=+102.213533572" watchObservedRunningTime="2026-06-03 15:50:40.496895995 +0000 UTC m=+102.215341106"
Jun 03 15:50:42.820193 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:42.820151    2562 scope.go:117] "RemoveContainer" containerID="c090c7fee96cdb743d46c38528392a866569f27d676bb14730b0adca5faf9bf4"
Jun 03 15:50:43.479154 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:43.479124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:50:43.479355 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:43.479200    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" event={"ID":"aba055c2-fc0c-4473-abdc-ee2f24efa1d7","Type":"ContainerStarted","Data":"842c9728a103b5e017aff47beb83803a8aa6e7353e1861344d38263ce3f8c0e9"}
Jun 03 15:50:43.479487 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:43.479466    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:50:43.507742 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:43.507684    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg" podStartSLOduration=82.4955667 podStartE2EDuration="1m36.507668226s" podCreationTimestamp="2026-06-03 15:49:07 +0000 UTC" firstStartedPulling="2026-06-03 15:49:35.46172842 +0000 UTC m=+37.180173511" lastFinishedPulling="2026-06-03 15:49:49.47382994 +0000 UTC m=+51.192275037" observedRunningTime="2026-06-03 15:50:43.506639032 +0000 UTC m=+105.225084144" watchObservedRunningTime="2026-06-03 15:50:43.507668226 +0000 UTC m=+105.226113379"
Jun 03 15:50:43.631698 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:43.631668    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5lrcg"
Jun 03 15:50:48.945713 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.945665    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7n662"]
Jun 03 15:50:48.948259 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.948234    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:48.952672 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.952634    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 15:50:48.953242 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.953216    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-66bjq\""
Jun 03 15:50:48.953533 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.953493    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 15:50:48.953603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.953507    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 15:50:48.953603 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:48.953560    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 15:50:49.053938 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.053900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-wtmp\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054123 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.053954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lfth\" (UniqueName: \"kubernetes.io/projected/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-kube-api-access-4lfth\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054123 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.053990    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054123 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-tls\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054123 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-metrics-client-ca\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054257 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-sys\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054257 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-root\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054257 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.054257 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.054222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-textfile\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154656 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154619    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-sys\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154656 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154661    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-root\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154682    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-textfile\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154739    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-wtmp\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154756    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-sys\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154756    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-root\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154768    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lfth\" (UniqueName: \"kubernetes.io/projected/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-kube-api-access-4lfth\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154898    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-tls\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.154924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154925    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-metrics-client-ca\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.155350 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.154950    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-wtmp\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.155350 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.155195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-textfile\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.155459 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.155444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.155520 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.155497    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-metrics-client-ca\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.157496 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.157468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.157617 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.157573    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-node-exporter-tls\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.165188 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.165157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lfth\" (UniqueName: \"kubernetes.io/projected/a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d-kube-api-access-4lfth\") pod \"node-exporter-7n662\" (UID: \"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d\") " pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.258339 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.258234    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n662"
Jun 03 15:50:49.267524 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:50:49.267486    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90ecdb8_a5d3_4d4c_a25e_2f2ba19e910d.slice/crio-5650d383591e646b8ba965e0e3ff1fca51bba1218775ac8225ce01a0c2368486 WatchSource:0}: Error finding container 5650d383591e646b8ba965e0e3ff1fca51bba1218775ac8225ce01a0c2368486: Status 404 returned error can't find the container with id 5650d383591e646b8ba965e0e3ff1fca51bba1218775ac8225ce01a0c2368486
Jun 03 15:50:49.497646 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:49.497597    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n662" event={"ID":"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d","Type":"ContainerStarted","Data":"5650d383591e646b8ba965e0e3ff1fca51bba1218775ac8225ce01a0c2368486"}
Jun 03 15:50:50.502159 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:50.502119    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n662" event={"ID":"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d","Type":"ContainerStarted","Data":"ba66a7bed953f632b41dc3ae607a431b2ebda643049939e417341b94e7b73d2d"}
Jun 03 15:50:51.506428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:51.506393    2562 generic.go:358] "Generic (PLEG): container finished" podID="a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d" containerID="ba66a7bed953f632b41dc3ae607a431b2ebda643049939e417341b94e7b73d2d" exitCode=0
Jun 03 15:50:51.506795 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:51.506484    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n662" event={"ID":"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d","Type":"ContainerDied","Data":"ba66a7bed953f632b41dc3ae607a431b2ebda643049939e417341b94e7b73d2d"}
Jun 03 15:50:52.511996 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:52.511933    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n662" event={"ID":"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d","Type":"ContainerStarted","Data":"ae60a6b525920ede4d34d16d3d920027334fc47615d58952f419db418a63d6e0"}
Jun 03 15:50:52.512385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:52.512012    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n662" event={"ID":"a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d","Type":"ContainerStarted","Data":"6ed9354efed0d44eedf57b9be60d967473a2ede011e97ed8d68334c39bf91c60"}
Jun 03 15:50:52.538025 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:52.537942    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7n662" podStartSLOduration=3.462982061 podStartE2EDuration="4.537928288s" podCreationTimestamp="2026-06-03 15:50:48 +0000 UTC" firstStartedPulling="2026-06-03 15:50:49.269130016 +0000 UTC m=+110.987575108" lastFinishedPulling="2026-06-03 15:50:50.344076227 +0000 UTC m=+112.062521335" observedRunningTime="2026-06-03 15:50:52.536675895 +0000 UTC m=+114.255121008" watchObservedRunningTime="2026-06-03 15:50:52.537928288 +0000 UTC m=+114.256373440"
Jun 03 15:50:56.525378 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:56.525337    2562 generic.go:358] "Generic (PLEG): container finished" podID="a1fae33f-e500-42a8-b32b-8ca4d5ec82ac" containerID="01d59c6ab9108252830f0239bddfbd09e5679fd0c9ef8863235845456212feae" exitCode=0
Jun 03 15:50:56.525828 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:56.525391    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6" event={"ID":"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac","Type":"ContainerDied","Data":"01d59c6ab9108252830f0239bddfbd09e5679fd0c9ef8863235845456212feae"}
Jun 03 15:50:56.525828 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:56.525700    2562 scope.go:117] "RemoveContainer" containerID="01d59c6ab9108252830f0239bddfbd09e5679fd0c9ef8863235845456212feae"
Jun 03 15:50:57.529590 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:50:57.529535    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-44fs6" event={"ID":"a1fae33f-e500-42a8-b32b-8ca4d5ec82ac","Type":"ContainerStarted","Data":"b15ad9c7200a2951230bc5f4811cd3da5eef292389d1306c794bda39b22eccdc"}
Jun 03 15:51:01.546776 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:01.546731    2562 generic.go:358] "Generic (PLEG): container finished" podID="d863496a-7e17-4cc8-99d8-5d13ee7d2de4" containerID="2558f1ad947b60a0729168f7b170ab7120ee8037a4276df0999ecc29d9f4ddc3" exitCode=0
Jun 03 15:51:01.547242 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:01.546809    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt" event={"ID":"d863496a-7e17-4cc8-99d8-5d13ee7d2de4","Type":"ContainerDied","Data":"2558f1ad947b60a0729168f7b170ab7120ee8037a4276df0999ecc29d9f4ddc3"}
Jun 03 15:51:01.547242 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:01.547179    2562 scope.go:117] "RemoveContainer" containerID="2558f1ad947b60a0729168f7b170ab7120ee8037a4276df0999ecc29d9f4ddc3"
Jun 03 15:51:02.551482 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:02.551445    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zjlxt" event={"ID":"d863496a-7e17-4cc8-99d8-5d13ee7d2de4","Type":"ContainerStarted","Data":"71ed3324a93f2bb9db56e09a9ee43cfedf0720e7bb38749031ffb5f895be561f"}
Jun 03 15:51:04.822427 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:04.822382    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerName="registry" containerID="cri-o://eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23" gracePeriod=30
Jun 03 15:51:05.074669 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.074599    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:51:05.192674 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192628    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192674 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192678    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192695    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcks4\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192719    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192737    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192757    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192778    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.192924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.192805    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets\") pod \"9b73d258-1ba6-4410-b402-7267c8aa7d40\" (UID: \"9b73d258-1ba6-4410-b402-7267c8aa7d40\") "
Jun 03 15:51:05.193368 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.193308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 15:51:05.193368 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.193315    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 15:51:05.195496 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.195453    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4" (OuterVolumeSpecName: "kube-api-access-lcks4") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "kube-api-access-lcks4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:51:05.195496 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.195489    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 15:51:05.195691 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.195636    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:51:05.195691 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.195647    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 15:51:05.195761 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.195687    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:51:05.201862 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.201824    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b73d258-1ba6-4410-b402-7267c8aa7d40" (UID: "9b73d258-1ba6-4410-b402-7267c8aa7d40"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 15:51:05.294353 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294317    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-tls\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294353 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294350    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-bound-sa-token\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294353 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294359    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcks4\" (UniqueName: \"kubernetes.io/projected/9b73d258-1ba6-4410-b402-7267c8aa7d40-kube-api-access-lcks4\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294600 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294369    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-registry-certificates\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294600 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294379    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b73d258-1ba6-4410-b402-7267c8aa7d40-ca-trust-extracted\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294600 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294387    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b73d258-1ba6-4410-b402-7267c8aa7d40-trusted-ca\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294600 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294396    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-image-registry-private-configuration\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.294600 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.294405    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b73d258-1ba6-4410-b402-7267c8aa7d40-installation-pull-secrets\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:51:05.560874 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.560835    2562 generic.go:358] "Generic (PLEG): container finished" podID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerID="eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23" exitCode=0
Jun 03 15:51:05.561084 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.560907    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c8fb899d-z455c"
Jun 03 15:51:05.561084 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.560920    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" event={"ID":"9b73d258-1ba6-4410-b402-7267c8aa7d40","Type":"ContainerDied","Data":"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"}
Jun 03 15:51:05.561084 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.560963    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c8fb899d-z455c" event={"ID":"9b73d258-1ba6-4410-b402-7267c8aa7d40","Type":"ContainerDied","Data":"76ac12bdf02182e258b18f0e6fa9a69e08ea0d611b5fa1c588444ac08a09d661"}
Jun 03 15:51:05.561084 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.561008    2562 scope.go:117] "RemoveContainer" containerID="eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"
Jun 03 15:51:05.569701 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.569672    2562 scope.go:117] "RemoveContainer" containerID="eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"
Jun 03 15:51:05.570023 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:51:05.570001    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23\": container with ID starting with eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23 not found: ID does not exist" containerID="eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"
Jun 03 15:51:05.570078 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.570033    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23"} err="failed to get container status \"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23\": rpc error: code = NotFound desc = could not find container \"eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23\": container with ID starting with eb5539e3cf9f91bed663f4e27486ef11cc90cc6b52cba79ce2015b2328397a23 not found: ID does not exist"
Jun 03 15:51:05.584571 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.584536    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:51:05.591560 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:05.591527    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c8fb899d-z455c"]
Jun 03 15:51:06.824531 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:06.824496    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" path="/var/lib/kubelet/pods/9b73d258-1ba6-4410-b402-7267c8aa7d40/volumes"
Jun 03 15:51:07.614701 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:07.614659    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:51:07.617293 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:07.617254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c0300be-0c52-4fcf-a35f-eb646dafd23e-metrics-certs\") pod \"network-metrics-daemon-p8n47\" (UID: \"2c0300be-0c52-4fcf-a35f-eb646dafd23e\") " pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:51:07.741712 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:07.741663    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\""
Jun 03 15:51:07.749265 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:07.749220    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8n47"
Jun 03 15:51:07.893891 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:07.893861    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8n47"]
Jun 03 15:51:07.895888 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:51:07.895858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0300be_0c52_4fcf_a35f_eb646dafd23e.slice/crio-3d44783949d03121a1d5596dd8930d5e16d404d60e2a80da93595166a2c54df2 WatchSource:0}: Error finding container 3d44783949d03121a1d5596dd8930d5e16d404d60e2a80da93595166a2c54df2: Status 404 returned error can't find the container with id 3d44783949d03121a1d5596dd8930d5e16d404d60e2a80da93595166a2c54df2
Jun 03 15:51:08.571734 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:08.571688    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8n47" event={"ID":"2c0300be-0c52-4fcf-a35f-eb646dafd23e","Type":"ContainerStarted","Data":"3d44783949d03121a1d5596dd8930d5e16d404d60e2a80da93595166a2c54df2"}
Jun 03 15:51:09.576461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:09.576364    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8n47" event={"ID":"2c0300be-0c52-4fcf-a35f-eb646dafd23e","Type":"ContainerStarted","Data":"aae019a7b260d0e827d272ff15dd528e7a26e9d71546dbbfdecd55c49bf44046"}
Jun 03 15:51:09.576461 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:09.576403    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8n47" event={"ID":"2c0300be-0c52-4fcf-a35f-eb646dafd23e","Type":"ContainerStarted","Data":"2737b6abc2eac01a8a9e463526536bc24781906f1a2589d0e39c4460145af1f0"}
Jun 03 15:51:09.596708 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:09.596645    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8n47" podStartSLOduration=129.190532887 podStartE2EDuration="2m10.596627437s" podCreationTimestamp="2026-06-03 15:48:59 +0000 UTC" firstStartedPulling="2026-06-03 15:51:07.89839738 +0000 UTC m=+129.616842471" lastFinishedPulling="2026-06-03 15:51:09.304491926 +0000 UTC m=+131.022937021" observedRunningTime="2026-06-03 15:51:09.595132271 +0000 UTC m=+131.313577375" watchObservedRunningTime="2026-06-03 15:51:09.596627437 +0000 UTC m=+131.315072613"
Jun 03 15:51:10.581378 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:10.581288    2562 generic.go:358] "Generic (PLEG): container finished" podID="32a6673a-b8ef-4140-a086-ede4fb74aa17" containerID="0ed9f9f419e3600d3bfda3d3d8c82b8a577319c858d3ab3f4079db71b6f91fba" exitCode=0
Jun 03 15:51:10.581378 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:10.581365    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dtz65" event={"ID":"32a6673a-b8ef-4140-a086-ede4fb74aa17","Type":"ContainerDied","Data":"0ed9f9f419e3600d3bfda3d3d8c82b8a577319c858d3ab3f4079db71b6f91fba"}
Jun 03 15:51:10.581871 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:10.581857    2562 scope.go:117] "RemoveContainer" containerID="0ed9f9f419e3600d3bfda3d3d8c82b8a577319c858d3ab3f4079db71b6f91fba"
Jun 03 15:51:11.589938 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:11.589902    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dtz65" event={"ID":"32a6673a-b8ef-4140-a086-ede4fb74aa17","Type":"ContainerStarted","Data":"5f11fb3babc58a1cd3f5ab2a4d78da366b6e85a4ab078af2c9dd02e6e8961972"}
Jun 03 15:51:12.725547 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:12.725513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-f5q85_1dbd68ca-2505-4ac4-a44e-74c13b9a356f/cluster-monitoring-operator/0.log"
Jun 03 15:51:13.781763 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:13.781718    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" podUID="818bccad-ae01-414d-a772-f7e6ab770c68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 15:51:14.523670 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:14.523641    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/init-textfile/0.log"
Jun 03 15:51:14.723273 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:14.723242    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/node-exporter/0.log"
Jun 03 15:51:14.923093 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:14.923037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/kube-rbac-proxy/0.log"
Jun 03 15:51:19.522776 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:19.522740    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-xqsq2_4e3dd312-b361-41d0-aca5-dbc75fd21d16/networking-console-plugin/0.log"
Jun 03 15:51:19.723183 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:19.723149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:51:19.928298 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:19.928268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/3.log"
Jun 03 15:51:23.780999 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:23.780945    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" podUID="818bccad-ae01-414d-a772-f7e6ab770c68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 15:51:33.780948 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:33.780898    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" podUID="818bccad-ae01-414d-a772-f7e6ab770c68" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 15:51:33.781417 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:33.781018    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6"
Jun 03 15:51:33.781566 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:33.781544    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"238241e00686d1a994a8fbc579a5b10049d089539557b6af23d76ab07fa49cac"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 03 15:51:33.781602 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:33.781586    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" podUID="818bccad-ae01-414d-a772-f7e6ab770c68" containerName="service-proxy" containerID="cri-o://238241e00686d1a994a8fbc579a5b10049d089539557b6af23d76ab07fa49cac" gracePeriod=30
Jun 03 15:51:34.662430 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:34.662393    2562 generic.go:358] "Generic (PLEG): container finished" podID="818bccad-ae01-414d-a772-f7e6ab770c68" containerID="238241e00686d1a994a8fbc579a5b10049d089539557b6af23d76ab07fa49cac" exitCode=2
Jun 03 15:51:34.662684 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:34.662463    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerDied","Data":"238241e00686d1a994a8fbc579a5b10049d089539557b6af23d76ab07fa49cac"}
Jun 03 15:51:34.662684 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:51:34.662504    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6944d6c896-s8bq6" event={"ID":"818bccad-ae01-414d-a772-f7e6ab770c68","Type":"ContainerStarted","Data":"4f77f09035292a81a72a140c1f1056ea0d77ed5ed9c673c37905f5b2c47b0e4a"}
Jun 03 15:53:58.730960 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:53:58.730916    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:53:58.731531 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:53:58.731322    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:53:58.738570 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:53:58.738538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:53:58.739019 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:53:58.738993    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:53:58.741919 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:53:58.741892    2562 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 15:56:18.282492 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.282451    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"]
Jun 03 15:56:18.282954 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.282790    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerName="registry"
Jun 03 15:56:18.282954 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.282803    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerName="registry"
Jun 03 15:56:18.282954 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.282896    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b73d258-1ba6-4410-b402-7267c8aa7d40" containerName="registry"
Jun 03 15:56:18.285804 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.285784    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.291759 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.291728    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 15:56:18.292891 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.292864    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 15:56:18.293021 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.292889    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 15:56:18.293216 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.293200    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 15:56:18.305266 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.305228    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gqrbj\""
Jun 03 15:56:18.324499 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.324462    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"]
Jun 03 15:56:18.408749 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.408702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.408749 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.408748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.409029 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.408769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srlkx\" (UniqueName: \"kubernetes.io/projected/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-kube-api-access-srlkx\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.409029 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.408832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.409029 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.408903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.509350 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.509305    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.509350 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.509347    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.509628 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.509377    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srlkx\" (UniqueName: \"kubernetes.io/projected/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-kube-api-access-srlkx\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.509628 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.509406    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.509628 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.509459    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.510082 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.510055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.512454 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.512423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.512608 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.512482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.512608 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.512568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.520390 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.520359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srlkx\" (UniqueName: \"kubernetes.io/projected/94e5315d-7b65-460b-959f-e1e9b2bd7c2a-kube-api-access-srlkx\") pod \"opendatahub-operator-controller-manager-58656688f4-2g4kz\" (UID: \"94e5315d-7b65-460b-959f-e1e9b2bd7c2a\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.596208 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.596175    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:18.751290 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.751221    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"]
Jun 03 15:56:18.755656 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:18.755626    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e5315d_7b65_460b_959f_e1e9b2bd7c2a.slice/crio-706ca6e158f420b36131658e46aed3577adeaa47d7a5947047239f32e2d484f2 WatchSource:0}: Error finding container 706ca6e158f420b36131658e46aed3577adeaa47d7a5947047239f32e2d484f2: Status 404 returned error can't find the container with id 706ca6e158f420b36131658e46aed3577adeaa47d7a5947047239f32e2d484f2
Jun 03 15:56:18.757265 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:18.757244    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 15:56:19.487893 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:19.487835    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz" event={"ID":"94e5315d-7b65-460b-959f-e1e9b2bd7c2a","Type":"ContainerStarted","Data":"706ca6e158f420b36131658e46aed3577adeaa47d7a5947047239f32e2d484f2"}
Jun 03 15:56:22.501081 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:22.501045    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz" event={"ID":"94e5315d-7b65-460b-959f-e1e9b2bd7c2a","Type":"ContainerStarted","Data":"e6b420a23e7922b22f5d6262f74776025c8f76d255823f2b00c8f77bef4ba721"}
Jun 03 15:56:23.505575 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:23.505536    2562 generic.go:358] "Generic (PLEG): container finished" podID="94e5315d-7b65-460b-959f-e1e9b2bd7c2a" containerID="e6b420a23e7922b22f5d6262f74776025c8f76d255823f2b00c8f77bef4ba721" exitCode=0
Jun 03 15:56:23.506019 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:23.505593    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz" event={"ID":"94e5315d-7b65-460b-959f-e1e9b2bd7c2a","Type":"ContainerDied","Data":"e6b420a23e7922b22f5d6262f74776025c8f76d255823f2b00c8f77bef4ba721"}
Jun 03 15:56:24.510576 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:24.510530    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz" event={"ID":"94e5315d-7b65-460b-959f-e1e9b2bd7c2a","Type":"ContainerStarted","Data":"bc6ba05581e3b2bec8b5b2bbbc0b79c7d55879c54cb36aa7283eb8d2645a66e3"}
Jun 03 15:56:24.510993 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:24.510671    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:24.534863 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:24.534693    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz" podStartSLOduration=1.474803566 podStartE2EDuration="6.534676784s" podCreationTimestamp="2026-06-03 15:56:18 +0000 UTC" firstStartedPulling="2026-06-03 15:56:18.757371223 +0000 UTC m=+440.475816314" lastFinishedPulling="2026-06-03 15:56:23.817244429 +0000 UTC m=+445.535689532" observedRunningTime="2026-06-03 15:56:24.533081687 +0000 UTC m=+446.251526799" watchObservedRunningTime="2026-06-03 15:56:24.534676784 +0000 UTC m=+446.253121897"
Jun 03 15:56:35.516063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:35.516030    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-2g4kz"
Jun 03 15:56:38.014971 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.014929    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"]
Jun 03 15:56:38.024909 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.024877    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.029473 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.029449    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 15:56:38.030513 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.030360    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k2qbd\""
Jun 03 15:56:38.030513 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.030374    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 15:56:38.048932 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.048898    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"]
Jun 03 15:56:38.072008 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.071934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q59x\" (UniqueName: \"kubernetes.io/projected/91a881cd-c226-4b62-953f-3d3784d31147-kube-api-access-6q59x\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.072008 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.072009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a881cd-c226-4b62-953f-3d3784d31147-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.072224 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.072030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a881cd-c226-4b62-953f-3d3784d31147-tmp\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.173450 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.173409    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q59x\" (UniqueName: \"kubernetes.io/projected/91a881cd-c226-4b62-953f-3d3784d31147-kube-api-access-6q59x\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.173677 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.173470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a881cd-c226-4b62-953f-3d3784d31147-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.173677 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.173491    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a881cd-c226-4b62-953f-3d3784d31147-tmp\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.175924 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.175891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a881cd-c226-4b62-953f-3d3784d31147-tmp\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.176076 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.176053    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91a881cd-c226-4b62-953f-3d3784d31147-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.198589 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.198555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q59x\" (UniqueName: \"kubernetes.io/projected/91a881cd-c226-4b62-953f-3d3784d31147-kube-api-access-6q59x\") pod \"kube-auth-proxy-685b7b64cc-7mrs9\" (UID: \"91a881cd-c226-4b62-953f-3d3784d31147\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.265350 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.265257    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-fccbz"]
Jun 03 15:56:38.267579 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.267558    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.271245 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.271222    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 03 15:56:38.271386 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.271336    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x4qvq\""
Jun 03 15:56:38.273960 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.273914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5cg\" (UniqueName: \"kubernetes.io/projected/6c32b770-6038-4c20-9a3e-fd9d581ac930-kube-api-access-dm5cg\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.274098 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.274031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.280757 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.280728    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fccbz"]
Jun 03 15:56:38.334671 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.334627    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"
Jun 03 15:56:38.375286 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.375251    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5cg\" (UniqueName: \"kubernetes.io/projected/6c32b770-6038-4c20-9a3e-fd9d581ac930-kube-api-access-dm5cg\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.375467 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.375308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.375467 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:38.375442    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 15:56:38.375552 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:38.375506    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert podName:6c32b770-6038-4c20-9a3e-fd9d581ac930 nodeName:}" failed. No retries permitted until 2026-06-03 15:56:38.875487032 +0000 UTC m=+460.593932142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert") pod "odh-model-controller-76588b95-fccbz" (UID: "6c32b770-6038-4c20-9a3e-fd9d581ac930") : secret "odh-model-controller-webhook-cert" not found
Jun 03 15:56:38.397507 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.397451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5cg\" (UniqueName: \"kubernetes.io/projected/6c32b770-6038-4c20-9a3e-fd9d581ac930-kube-api-access-dm5cg\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.511638 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.511611    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9"]
Jun 03 15:56:38.513004 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:38.512956    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a881cd_c226_4b62_953f_3d3784d31147.slice/crio-c5a141bc5c0dace9609e23c8cc246b9612321aaa3056d01b2448ec119330a274 WatchSource:0}: Error finding container c5a141bc5c0dace9609e23c8cc246b9612321aaa3056d01b2448ec119330a274: Status 404 returned error can't find the container with id c5a141bc5c0dace9609e23c8cc246b9612321aaa3056d01b2448ec119330a274
Jun 03 15:56:38.563945 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.563900    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9" event={"ID":"91a881cd-c226-4b62-953f-3d3784d31147","Type":"ContainerStarted","Data":"c5a141bc5c0dace9609e23c8cc246b9612321aaa3056d01b2448ec119330a274"}
Jun 03 15:56:38.880155 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:38.880117    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:38.880376 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:38.880256    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 15:56:38.880376 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:38.880316    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert podName:6c32b770-6038-4c20-9a3e-fd9d581ac930 nodeName:}" failed. No retries permitted until 2026-06-03 15:56:39.880297635 +0000 UTC m=+461.598742745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert") pod "odh-model-controller-76588b95-fccbz" (UID: "6c32b770-6038-4c20-9a3e-fd9d581ac930") : secret "odh-model-controller-webhook-cert" not found
Jun 03 15:56:39.766179 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.766136    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qhg79"]
Jun 03 15:56:39.768835 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.768807    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:39.773490 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.773463    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 15:56:39.786787 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.786754    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qhg79"]
Jun 03 15:56:39.789046 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.789013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvccl\" (UniqueName: \"kubernetes.io/projected/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-kube-api-access-hvccl\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:39.789210 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.789189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:39.890183 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.890144    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvccl\" (UniqueName: \"kubernetes.io/projected/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-kube-api-access-hvccl\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:39.890366 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.890209    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:39.890366 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.890353    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:39.890484 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:39.890458    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 03 15:56:39.890538 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:39.890529    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs podName:67e5e796-e40b-46f9-b6a5-879bd1a8bf4a nodeName:}" failed. No retries permitted until 2026-06-03 15:56:40.390509488 +0000 UTC m=+462.108954596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs") pod "model-serving-api-6577596cd5-qhg79" (UID: "67e5e796-e40b-46f9-b6a5-879bd1a8bf4a") : secret "model-serving-api-tls" not found
Jun 03 15:56:39.892946 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.892917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c32b770-6038-4c20-9a3e-fd9d581ac930-cert\") pod \"odh-model-controller-76588b95-fccbz\" (UID: \"6c32b770-6038-4c20-9a3e-fd9d581ac930\") " pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:39.906240 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:39.906205    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvccl\" (UniqueName: \"kubernetes.io/projected/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-kube-api-access-hvccl\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:40.078715 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.078623    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:40.394888 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.394738    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:40.398796 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.398760    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e5e796-e40b-46f9-b6a5-879bd1a8bf4a-tls-certs\") pod \"model-serving-api-6577596cd5-qhg79\" (UID: \"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a\") " pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:40.683171 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.682636    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:40.792353 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.792324    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fccbz"]
Jun 03 15:56:40.795632 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:40.795599    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c32b770_6038_4c20_9a3e_fd9d581ac930.slice/crio-4dbf182459c59a235029f2b05f930a937bcb35e64e5976a65d1517c3d8ae2ae6 WatchSource:0}: Error finding container 4dbf182459c59a235029f2b05f930a937bcb35e64e5976a65d1517c3d8ae2ae6: Status 404 returned error can't find the container with id 4dbf182459c59a235029f2b05f930a937bcb35e64e5976a65d1517c3d8ae2ae6
Jun 03 15:56:40.860554 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:40.860507    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-qhg79"]
Jun 03 15:56:40.864127 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:40.864086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e5e796_e40b_46f9_b6a5_879bd1a8bf4a.slice/crio-f339dfaeff9de847439c4ab7d85bcce3a4e730c24e8fed983a7c7d722ce0cba9 WatchSource:0}: Error finding container f339dfaeff9de847439c4ab7d85bcce3a4e730c24e8fed983a7c7d722ce0cba9: Status 404 returned error can't find the container with id f339dfaeff9de847439c4ab7d85bcce3a4e730c24e8fed983a7c7d722ce0cba9
Jun 03 15:56:41.577835 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:41.577793    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fccbz" event={"ID":"6c32b770-6038-4c20-9a3e-fd9d581ac930","Type":"ContainerStarted","Data":"4dbf182459c59a235029f2b05f930a937bcb35e64e5976a65d1517c3d8ae2ae6"}
Jun 03 15:56:41.578914 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:41.578886    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-qhg79" event={"ID":"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a","Type":"ContainerStarted","Data":"f339dfaeff9de847439c4ab7d85bcce3a4e730c24e8fed983a7c7d722ce0cba9"}
Jun 03 15:56:42.584226 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:42.584180    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9" event={"ID":"91a881cd-c226-4b62-953f-3d3784d31147","Type":"ContainerStarted","Data":"f7720fedc01a2e6ae7e0c07548ba1a3e7e172fb13c12202eacf735ea226e7253"}
Jun 03 15:56:42.625263 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:42.625107    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-7mrs9" podStartSLOduration=2.5409026900000002 podStartE2EDuration="5.625088148s" podCreationTimestamp="2026-06-03 15:56:37 +0000 UTC" firstStartedPulling="2026-06-03 15:56:38.514748762 +0000 UTC m=+460.233193853" lastFinishedPulling="2026-06-03 15:56:41.598934207 +0000 UTC m=+463.317379311" observedRunningTime="2026-06-03 15:56:42.624232243 +0000 UTC m=+464.342677356" watchObservedRunningTime="2026-06-03 15:56:42.625088148 +0000 UTC m=+464.343533275"
Jun 03 15:56:44.591784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.591742    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-qhg79" event={"ID":"67e5e796-e40b-46f9-b6a5-879bd1a8bf4a","Type":"ContainerStarted","Data":"b5029b53882d79bc400b7ef475fd028d640033c4389081094548c5b456033e08"}
Jun 03 15:56:44.592269 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.591839    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:56:44.593225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.593200    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fccbz" event={"ID":"6c32b770-6038-4c20-9a3e-fd9d581ac930","Type":"ContainerStarted","Data":"bc41a15ea8e3269bcd9a5f6fe46d0c629aaa58a5a1967a1bf970f4810feaa5a1"}
Jun 03 15:56:44.593368 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.593354    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:44.620782 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.620731    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-qhg79" podStartSLOduration=2.014503126 podStartE2EDuration="5.62071423s" podCreationTimestamp="2026-06-03 15:56:39 +0000 UTC" firstStartedPulling="2026-06-03 15:56:40.866199902 +0000 UTC m=+462.584644992" lastFinishedPulling="2026-06-03 15:56:44.47241099 +0000 UTC m=+466.190856096" observedRunningTime="2026-06-03 15:56:44.619838515 +0000 UTC m=+466.338283631" watchObservedRunningTime="2026-06-03 15:56:44.62071423 +0000 UTC m=+466.339159344"
Jun 03 15:56:44.645621 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:44.645540    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-fccbz" podStartSLOduration=2.924698474 podStartE2EDuration="6.645520257s" podCreationTimestamp="2026-06-03 15:56:38 +0000 UTC" firstStartedPulling="2026-06-03 15:56:40.797015964 +0000 UTC m=+462.515461055" lastFinishedPulling="2026-06-03 15:56:44.517837734 +0000 UTC m=+466.236282838" observedRunningTime="2026-06-03 15:56:44.644745181 +0000 UTC m=+466.363190294" watchObservedRunningTime="2026-06-03 15:56:44.645520257 +0000 UTC m=+466.363965371"
Jun 03 15:56:49.775400 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.775359    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"]
Jun 03 15:56:49.779064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.779038    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.782686 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.782641    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"]
Jun 03 15:56:49.784784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.784754    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 15:56:49.785843 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.785822    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:49.787189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.787171    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nfp6k\""
Jun 03 15:56:49.788927 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.788912    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 15:56:49.789067 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.789047    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-l5s2f\""
Jun 03 15:56:49.804881 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.804846    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"]
Jun 03 15:56:49.813639 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.813604    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"]
Jun 03 15:56:49.880784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.880750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw58k\" (UniqueName: \"kubernetes.io/projected/d550b819-48ea-4253-b6d5-2437e21b30fd-kube-api-access-hw58k\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:49.880784 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.880789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jcd\" (UniqueName: \"kubernetes.io/projected/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-kube-api-access-89jcd\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.881063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.880912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.881063 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.880946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:49.981526 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.981479    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.981673 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.981545    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:49.981673 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.981602    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hw58k\" (UniqueName: \"kubernetes.io/projected/d550b819-48ea-4253-b6d5-2437e21b30fd-kube-api-access-hw58k\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:49.981790 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:49.981678    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jun 03 15:56:49.981790 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.981722    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89jcd\" (UniqueName: \"kubernetes.io/projected/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-kube-api-access-89jcd\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.981790 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:56:49.981757    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert podName:d550b819-48ea-4253-b6d5-2437e21b30fd nodeName:}" failed. No retries permitted until 2026-06-03 15:56:50.481727725 +0000 UTC m=+472.200172821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert") pod "llmisvc-controller-manager-c6b9847d7-d22t5" (UID: "d550b819-48ea-4253-b6d5-2437e21b30fd") : secret "llmisvc-webhook-server-cert" not found
Jun 03 15:56:49.984351 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.984323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:49.995224 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:49.995186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw58k\" (UniqueName: \"kubernetes.io/projected/d550b819-48ea-4253-b6d5-2437e21b30fd-kube-api-access-hw58k\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:50.004717 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.004684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jcd\" (UniqueName: \"kubernetes.io/projected/61bb0b00-e7fd-4e69-9446-c3734e85ce9f-kube-api-access-89jcd\") pod \"kserve-controller-manager-7c99ffcdcd-9bvhs\" (UID: \"61bb0b00-e7fd-4e69-9446-c3734e85ce9f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:50.089587 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.089493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:50.258183 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.258146    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"]
Jun 03 15:56:50.261383 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:50.261348    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bb0b00_e7fd_4e69_9446_c3734e85ce9f.slice/crio-17aa3f85636bffa0e7a7500e3599058a342fd38dbf82712ea4470e017aef5436 WatchSource:0}: Error finding container 17aa3f85636bffa0e7a7500e3599058a342fd38dbf82712ea4470e017aef5436: Status 404 returned error can't find the container with id 17aa3f85636bffa0e7a7500e3599058a342fd38dbf82712ea4470e017aef5436
Jun 03 15:56:50.486396 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.486349    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:50.488943 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.488919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d550b819-48ea-4253-b6d5-2437e21b30fd-cert\") pod \"llmisvc-controller-manager-c6b9847d7-d22t5\" (UID: \"d550b819-48ea-4253-b6d5-2437e21b30fd\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:50.618903 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.618864    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs" event={"ID":"61bb0b00-e7fd-4e69-9446-c3734e85ce9f","Type":"ContainerStarted","Data":"17aa3f85636bffa0e7a7500e3599058a342fd38dbf82712ea4470e017aef5436"}
Jun 03 15:56:50.697150 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.697107    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:50.841110 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:50.841075    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"]
Jun 03 15:56:50.844277 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:56:50.844252    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd550b819_48ea_4253_b6d5_2437e21b30fd.slice/crio-aab6469c7dc28c4bcf3d24c4aa124cb1440f2a89811b4b99a96add080af10c8e WatchSource:0}: Error finding container aab6469c7dc28c4bcf3d24c4aa124cb1440f2a89811b4b99a96add080af10c8e: Status 404 returned error can't find the container with id aab6469c7dc28c4bcf3d24c4aa124cb1440f2a89811b4b99a96add080af10c8e
Jun 03 15:56:51.624028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:51.623964    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5" event={"ID":"d550b819-48ea-4253-b6d5-2437e21b30fd","Type":"ContainerStarted","Data":"aab6469c7dc28c4bcf3d24c4aa124cb1440f2a89811b4b99a96add080af10c8e"}
Jun 03 15:56:53.633038 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:53.633002    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs" event={"ID":"61bb0b00-e7fd-4e69-9446-c3734e85ce9f","Type":"ContainerStarted","Data":"c4eb7762ba0332201b3f01d7a36f8091832adda3bb27ad8d0e65a9cbf20ff5ce"}
Jun 03 15:56:53.633551 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:53.633104    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:56:54.637559 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:54.637525    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5" event={"ID":"d550b819-48ea-4253-b6d5-2437e21b30fd","Type":"ContainerStarted","Data":"7544876f7c809b785ee201d120af451402c66c6495758900ce78dd2ffc3fe4eb"}
Jun 03 15:56:54.638016 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:54.637615    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:56:54.682094 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:54.682025    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5" podStartSLOduration=2.292194376 podStartE2EDuration="5.682009198s" podCreationTimestamp="2026-06-03 15:56:49 +0000 UTC" firstStartedPulling="2026-06-03 15:56:50.845695881 +0000 UTC m=+472.564140972" lastFinishedPulling="2026-06-03 15:56:54.235510702 +0000 UTC m=+475.953955794" observedRunningTime="2026-06-03 15:56:54.681316948 +0000 UTC m=+476.399762063" watchObservedRunningTime="2026-06-03 15:56:54.682009198 +0000 UTC m=+476.400454616"
Jun 03 15:56:54.682696 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:54.682666    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs" podStartSLOduration=2.613197374 podStartE2EDuration="5.682655247s" podCreationTimestamp="2026-06-03 15:56:49 +0000 UTC" firstStartedPulling="2026-06-03 15:56:50.262588513 +0000 UTC m=+471.981033605" lastFinishedPulling="2026-06-03 15:56:53.332046387 +0000 UTC m=+475.050491478" observedRunningTime="2026-06-03 15:56:53.730179644 +0000 UTC m=+475.448624758" watchObservedRunningTime="2026-06-03 15:56:54.682655247 +0000 UTC m=+476.401100359"
Jun 03 15:56:55.598515 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:55.598478    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-fccbz"
Jun 03 15:56:55.600433 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:56:55.600405    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-qhg79"
Jun 03 15:57:07.662873 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.662835    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"]
Jun 03 15:57:07.667862 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.667833    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.670080 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.670055    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 15:57:07.670080 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.670071    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sncdd\""
Jun 03 15:57:07.678881 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.678840    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"]
Jun 03 15:57:07.747190 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747190 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfn6s\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-kube-api-access-nfn6s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca10c3c-d14b-4c03-937b-5337baea4434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.747421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.747417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca10c3c-d14b-4c03-937b-5337baea4434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848571 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848519    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848587    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848625    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848654    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848688    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfn6s\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-kube-api-access-nfn6s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848717    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.848778 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848752    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849124 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848806    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca10c3c-d14b-4c03-937b-5337baea4434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849124 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.848840    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca10c3c-d14b-4c03-937b-5337baea4434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849124 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.849034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849124 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.849039    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849336 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.849313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849654 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.849613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.849936 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.849641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aca10c3c-d14b-4c03-937b-5337baea4434-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.851616 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.851579    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aca10c3c-d14b-4c03-937b-5337baea4434-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.851731 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.851711    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aca10c3c-d14b-4c03-937b-5337baea4434-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.868863 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.868820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfn6s\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-kube-api-access-nfn6s\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.873126 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.873097    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aca10c3c-d14b-4c03-937b-5337baea4434-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs97br\" (UID: \"aca10c3c-d14b-4c03-937b-5337baea4434\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:07.981275 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:07.981190    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:08.148145 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.148055    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"]
Jun 03 15:57:08.150482 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:57:08.150444    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca10c3c_d14b_4c03_937b_5337baea4434.slice/crio-5ec52865c1abb3220dba227d7d53e57f21497ee0d76700d3d5e860cf90171aff WatchSource:0}: Error finding container 5ec52865c1abb3220dba227d7d53e57f21497ee0d76700d3d5e860cf90171aff: Status 404 returned error can't find the container with id 5ec52865c1abb3220dba227d7d53e57f21497ee0d76700d3d5e860cf90171aff
Jun 03 15:57:08.418298 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.418260    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-fts9p"]
Jun 03 15:57:08.423591 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.423563    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.426085 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.426055    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t6cr4\""
Jun 03 15:57:08.426085 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.426067    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 15:57:08.430334 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.430302    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-fts9p"]
Jun 03 15:57:08.554624 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.554579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986hj\" (UniqueName: \"kubernetes.io/projected/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-kube-api-access-986hj\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.554811 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.554691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-redirect-config\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.656075 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.656035    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-986hj\" (UniqueName: \"kubernetes.io/projected/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-kube-api-access-986hj\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.656261 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.656207    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-redirect-config\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.657069 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.657036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-redirect-config\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.667421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.667390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-986hj\" (UniqueName: \"kubernetes.io/projected/cfef17ac-b0ef-41a7-97f1-28e25c1aafa1-kube-api-access-986hj\") pod \"dashboard-redirect-78c4457769-fts9p\" (UID: \"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1\") " pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.684888 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.684795    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br" event={"ID":"aca10c3c-d14b-4c03-937b-5337baea4434","Type":"ContainerStarted","Data":"5ec52865c1abb3220dba227d7d53e57f21497ee0d76700d3d5e860cf90171aff"}
Jun 03 15:57:08.736312 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.736274    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78c4457769-fts9p"
Jun 03 15:57:08.918473 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:08.918384    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78c4457769-fts9p"]
Jun 03 15:57:09.090998 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:57:09.090885    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef17ac_b0ef_41a7_97f1_28e25c1aafa1.slice/crio-2cca7159b113c31311c37e980cec8656c855b965969d91fbb37f692a2e994ffd WatchSource:0}: Error finding container 2cca7159b113c31311c37e980cec8656c855b965969d91fbb37f692a2e994ffd: Status 404 returned error can't find the container with id 2cca7159b113c31311c37e980cec8656c855b965969d91fbb37f692a2e994ffd
Jun 03 15:57:09.689917 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:09.689876    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78c4457769-fts9p" event={"ID":"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1","Type":"ContainerStarted","Data":"2cca7159b113c31311c37e980cec8656c855b965969d91fbb37f692a2e994ffd"}
Jun 03 15:57:10.482241 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.482195    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:57:10.482352 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.482284    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:57:10.482352 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.482319    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:57:10.697225 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.697171    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br" event={"ID":"aca10c3c-d14b-4c03-937b-5337baea4434","Type":"ContainerStarted","Data":"54643cd1950bc6cfd4cf8df4b9ab015658a20374b663bbbe3187433286015316"}
Jun 03 15:57:10.720585 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.720517    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br" podStartSLOduration=1.3912685759999999 podStartE2EDuration="3.720495573s" podCreationTimestamp="2026-06-03 15:57:07 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.152658871 +0000 UTC m=+489.871103962" lastFinishedPulling="2026-06-03 15:57:10.481885863 +0000 UTC m=+492.200330959" observedRunningTime="2026-06-03 15:57:10.718916998 +0000 UTC m=+492.437362112" watchObservedRunningTime="2026-06-03 15:57:10.720495573 +0000 UTC m=+492.438940688"
Jun 03 15:57:10.982196 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:10.982153    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:11.987285 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:11.987254    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:12.706623 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:12.706590    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:12.707774 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:12.707752    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs97br"
Jun 03 15:57:14.715007 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:14.714897    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78c4457769-fts9p" event={"ID":"cfef17ac-b0ef-41a7-97f1-28e25c1aafa1","Type":"ContainerStarted","Data":"a3e8947e95f4bf54e7b5c4867fa66782347c52ab09249226075f283131e6b670"}
Jun 03 15:57:14.738078 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:14.738021    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78c4457769-fts9p" podStartSLOduration=1.464368931 podStartE2EDuration="6.738005109s" podCreationTimestamp="2026-06-03 15:57:08 +0000 UTC" firstStartedPulling="2026-06-03 15:57:09.092675688 +0000 UTC m=+490.811120779" lastFinishedPulling="2026-06-03 15:57:14.366311861 +0000 UTC m=+496.084756957" observedRunningTime="2026-06-03 15:57:14.736444682 +0000 UTC m=+496.454889795" watchObservedRunningTime="2026-06-03 15:57:14.738005109 +0000 UTC m=+496.456450235"
Jun 03 15:57:24.643182 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:24.643149    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9bvhs"
Jun 03 15:57:25.644426 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:25.644390    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-d22t5"
Jun 03 15:57:39.179385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.179343    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:39.185629 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.185596    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:39.187925 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.187898    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 15:57:39.188388 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.188361    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-657hz\""
Jun 03 15:57:39.188526 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.188392    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 15:57:39.190576 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.190549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvw2\" (UniqueName: \"kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2\") pod \"kuadrant-operator-catalog-5mpk8\" (UID: \"e7b6d8a5-0521-454e-b937-6f69f52fa62b\") " pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:39.202765 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.202721    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:39.291825 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.291783    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvw2\" (UniqueName: \"kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2\") pod \"kuadrant-operator-catalog-5mpk8\" (UID: \"e7b6d8a5-0521-454e-b937-6f69f52fa62b\") " pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:39.306577 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.306546    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvw2\" (UniqueName: \"kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2\") pod \"kuadrant-operator-catalog-5mpk8\" (UID: \"e7b6d8a5-0521-454e-b937-6f69f52fa62b\") " pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:39.497920 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.497817    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:39.535743 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.535704    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:39.642194 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.642166    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:39.645023 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:57:39.644968    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b6d8a5_0521_454e_b937_6f69f52fa62b.slice/crio-50ef3e7d784b53b81f727d9bd7ed471ff37d0a387f09a82c98e862e9549ed376 WatchSource:0}: Error finding container 50ef3e7d784b53b81f727d9bd7ed471ff37d0a387f09a82c98e862e9549ed376: Status 404 returned error can't find the container with id 50ef3e7d784b53b81f727d9bd7ed471ff37d0a387f09a82c98e862e9549ed376
Jun 03 15:57:39.744993 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.744930    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46hgj"]
Jun 03 15:57:39.748626 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.748561    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:39.757695 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.757664    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46hgj"]
Jun 03 15:57:39.795475 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.795432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xvb6\" (UniqueName: \"kubernetes.io/projected/7a5d1e67-ed10-4f3c-b862-a725dce1e0f5-kube-api-access-8xvb6\") pod \"kuadrant-operator-catalog-46hgj\" (UID: \"7a5d1e67-ed10-4f3c-b862-a725dce1e0f5\") " pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:39.799605 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.799574    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" event={"ID":"e7b6d8a5-0521-454e-b937-6f69f52fa62b","Type":"ContainerStarted","Data":"50ef3e7d784b53b81f727d9bd7ed471ff37d0a387f09a82c98e862e9549ed376"}
Jun 03 15:57:39.896569 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.896536    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xvb6\" (UniqueName: \"kubernetes.io/projected/7a5d1e67-ed10-4f3c-b862-a725dce1e0f5-kube-api-access-8xvb6\") pod \"kuadrant-operator-catalog-46hgj\" (UID: \"7a5d1e67-ed10-4f3c-b862-a725dce1e0f5\") " pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:39.907541 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:39.907512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xvb6\" (UniqueName: \"kubernetes.io/projected/7a5d1e67-ed10-4f3c-b862-a725dce1e0f5-kube-api-access-8xvb6\") pod \"kuadrant-operator-catalog-46hgj\" (UID: \"7a5d1e67-ed10-4f3c-b862-a725dce1e0f5\") " pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:40.059638 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:40.059534    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:40.220286 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:40.220260    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-46hgj"]
Jun 03 15:57:40.239827 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:57:40.239782    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5d1e67_ed10_4f3c_b862_a725dce1e0f5.slice/crio-6cf6aaccb4234023712173be57fd6b8ea03ea6d003b7e7850b15a5e1d319e026 WatchSource:0}: Error finding container 6cf6aaccb4234023712173be57fd6b8ea03ea6d003b7e7850b15a5e1d319e026: Status 404 returned error can't find the container with id 6cf6aaccb4234023712173be57fd6b8ea03ea6d003b7e7850b15a5e1d319e026
Jun 03 15:57:40.804545 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:40.804511    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46hgj" event={"ID":"7a5d1e67-ed10-4f3c-b862-a725dce1e0f5","Type":"ContainerStarted","Data":"6cf6aaccb4234023712173be57fd6b8ea03ea6d003b7e7850b15a5e1d319e026"}
Jun 03 15:57:41.810380 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:41.810344    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" event={"ID":"e7b6d8a5-0521-454e-b937-6f69f52fa62b","Type":"ContainerStarted","Data":"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"}
Jun 03 15:57:41.810828 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:41.810454    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" podUID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" containerName="registry-server" containerID="cri-o://c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b" gracePeriod=2
Jun 03 15:57:41.812119 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:41.812006    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-46hgj" event={"ID":"7a5d1e67-ed10-4f3c-b862-a725dce1e0f5","Type":"ContainerStarted","Data":"a8dba02a4e49542a525a59fd3face1c6e7c73a0b3843994d9188605f9fba8104"}
Jun 03 15:57:41.830170 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:41.830120    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" podStartSLOduration=0.758087364 podStartE2EDuration="2.830106757s" podCreationTimestamp="2026-06-03 15:57:39 +0000 UTC" firstStartedPulling="2026-06-03 15:57:39.646356226 +0000 UTC m=+521.364801317" lastFinishedPulling="2026-06-03 15:57:41.718375612 +0000 UTC m=+523.436820710" observedRunningTime="2026-06-03 15:57:41.829078309 +0000 UTC m=+523.547523422" watchObservedRunningTime="2026-06-03 15:57:41.830106757 +0000 UTC m=+523.548551869"
Jun 03 15:57:41.846233 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:41.846176    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-46hgj" podStartSLOduration=1.366164854 podStartE2EDuration="2.846159567s" podCreationTimestamp="2026-06-03 15:57:39 +0000 UTC" firstStartedPulling="2026-06-03 15:57:40.241364913 +0000 UTC m=+521.959810009" lastFinishedPulling="2026-06-03 15:57:41.721359632 +0000 UTC m=+523.439804722" observedRunningTime="2026-06-03 15:57:41.844322247 +0000 UTC m=+523.562767359" watchObservedRunningTime="2026-06-03 15:57:41.846159567 +0000 UTC m=+523.564604679"
Jun 03 15:57:42.067942 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.067917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5mpk8_e7b6d8a5-0521-454e-b937-6f69f52fa62b/registry-server/0.log"
Jun 03 15:57:42.068103 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.068002    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:42.118941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.118899    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjvw2\" (UniqueName: \"kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2\") pod \"e7b6d8a5-0521-454e-b937-6f69f52fa62b\" (UID: \"e7b6d8a5-0521-454e-b937-6f69f52fa62b\") "
Jun 03 15:57:42.121265 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.121238    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2" (OuterVolumeSpecName: "kube-api-access-gjvw2") pod "e7b6d8a5-0521-454e-b937-6f69f52fa62b" (UID: "e7b6d8a5-0521-454e-b937-6f69f52fa62b"). InnerVolumeSpecName "kube-api-access-gjvw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:57:42.219766 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.219703    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjvw2\" (UniqueName: \"kubernetes.io/projected/e7b6d8a5-0521-454e-b937-6f69f52fa62b-kube-api-access-gjvw2\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:57:42.817045 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5mpk8_e7b6d8a5-0521-454e-b937-6f69f52fa62b/registry-server/0.log"
Jun 03 15:57:42.817502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817049    2562 generic.go:358] "Generic (PLEG): container finished" podID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" containerID="c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b" exitCode=2
Jun 03 15:57:42.817502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817148    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8"
Jun 03 15:57:42.817502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817147    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" event={"ID":"e7b6d8a5-0521-454e-b937-6f69f52fa62b","Type":"ContainerDied","Data":"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"}
Jun 03 15:57:42.817502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817263    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mpk8" event={"ID":"e7b6d8a5-0521-454e-b937-6f69f52fa62b","Type":"ContainerDied","Data":"50ef3e7d784b53b81f727d9bd7ed471ff37d0a387f09a82c98e862e9549ed376"}
Jun 03 15:57:42.817502 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.817280    2562 scope.go:117] "RemoveContainer" containerID="c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"
Jun 03 15:57:42.827340 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.827093    2562 scope.go:117] "RemoveContainer" containerID="c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"
Jun 03 15:57:42.827593 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:57:42.827567    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b\": container with ID starting with c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b not found: ID does not exist" containerID="c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"
Jun 03 15:57:42.827672 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.827602    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b"} err="failed to get container status \"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b\": rpc error: code = NotFound desc = could not find container \"c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b\": container with ID starting with c02d3738d1863b874e1b92c786339c370e4e287159c0119bfb240d855063215b not found: ID does not exist"
Jun 03 15:57:42.849412 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.849367    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:42.854444 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:42.854411    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mpk8"]
Jun 03 15:57:44.825543 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:44.825441    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" path="/var/lib/kubelet/pods/e7b6d8a5-0521-454e-b937-6f69f52fa62b/volumes"
Jun 03 15:57:50.060404 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:50.060366    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:50.060404 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:50.060407    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:50.083893 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:50.083867    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:57:50.867707 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:57:50.867676    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-46hgj"
Jun 03 15:58:04.892234 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.892196    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"]
Jun 03 15:58:04.892648 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.892637    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" containerName="registry-server"
Jun 03 15:58:04.892690 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.892653    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" containerName="registry-server"
Jun 03 15:58:04.892762 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.892750    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7b6d8a5-0521-454e-b937-6f69f52fa62b" containerName="registry-server"
Jun 03 15:58:04.910851 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.910818    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"]
Jun 03 15:58:04.911031 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.910947    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:04.913325 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.913297    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kdhrn\""
Jun 03 15:58:04.913483 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:04.913310    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 03 15:58:05.019948 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.019905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzl5m\" (UniqueName: \"kubernetes.io/projected/5ccade3f-aa00-4327-9459-b17d8415733b-kube-api-access-dzl5m\") pod \"dns-operator-controller-manager-648d5c98bc-www8w\" (UID: \"5ccade3f-aa00-4327-9459-b17d8415733b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:05.121363 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.121305    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzl5m\" (UniqueName: \"kubernetes.io/projected/5ccade3f-aa00-4327-9459-b17d8415733b-kube-api-access-dzl5m\") pod \"dns-operator-controller-manager-648d5c98bc-www8w\" (UID: \"5ccade3f-aa00-4327-9459-b17d8415733b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:05.134387 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.134355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzl5m\" (UniqueName: \"kubernetes.io/projected/5ccade3f-aa00-4327-9459-b17d8415733b-kube-api-access-dzl5m\") pod \"dns-operator-controller-manager-648d5c98bc-www8w\" (UID: \"5ccade3f-aa00-4327-9459-b17d8415733b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:05.222406 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.222303    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:05.413913 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.413871    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"]
Jun 03 15:58:05.415395 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:58:05.415368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccade3f_aa00_4327_9459_b17d8415733b.slice/crio-648d718e92f19c3efd82136d415997228c0c2100fe39b1d452232e12d2967f6c WatchSource:0}: Error finding container 648d718e92f19c3efd82136d415997228c0c2100fe39b1d452232e12d2967f6c: Status 404 returned error can't find the container with id 648d718e92f19c3efd82136d415997228c0c2100fe39b1d452232e12d2967f6c
Jun 03 15:58:05.898790 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:05.898753    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w" event={"ID":"5ccade3f-aa00-4327-9459-b17d8415733b","Type":"ContainerStarted","Data":"648d718e92f19c3efd82136d415997228c0c2100fe39b1d452232e12d2967f6c"}
Jun 03 15:58:07.909115 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:07.909074    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w" event={"ID":"5ccade3f-aa00-4327-9459-b17d8415733b","Type":"ContainerStarted","Data":"a79d22b176cc78062e39f29ba1101525f520cccc9dc57ee8e3896c11e31ccd3a"}
Jun 03 15:58:07.909579 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:07.909190    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:07.954352 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:07.954296    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w" podStartSLOduration=2.012226569 podStartE2EDuration="3.954280133s" podCreationTimestamp="2026-06-03 15:58:04 +0000 UTC" firstStartedPulling="2026-06-03 15:58:05.417959939 +0000 UTC m=+547.136405032" lastFinishedPulling="2026-06-03 15:58:07.360013505 +0000 UTC m=+549.078458596" observedRunningTime="2026-06-03 15:58:07.953454305 +0000 UTC m=+549.671899430" watchObservedRunningTime="2026-06-03 15:58:07.954280133 +0000 UTC m=+549.672725245"
Jun 03 15:58:09.144969 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.144929    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4mnnl"]
Jun 03 15:58:09.148521 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.148498    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:09.151160 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.151127    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-99xhz\""
Jun 03 15:58:09.160355 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.160329    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4mnnl"]
Jun 03 15:58:09.257681 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.257643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jcc\" (UniqueName: \"kubernetes.io/projected/e0824d8c-073d-4600-b5e3-bd02f8729caa-kube-api-access-q9jcc\") pod \"authorino-operator-657f44b778-4mnnl\" (UID: \"e0824d8c-073d-4600-b5e3-bd02f8729caa\") " pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:09.358963 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.358906    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jcc\" (UniqueName: \"kubernetes.io/projected/e0824d8c-073d-4600-b5e3-bd02f8729caa-kube-api-access-q9jcc\") pod \"authorino-operator-657f44b778-4mnnl\" (UID: \"e0824d8c-073d-4600-b5e3-bd02f8729caa\") " pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:09.373550 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.373515    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jcc\" (UniqueName: \"kubernetes.io/projected/e0824d8c-073d-4600-b5e3-bd02f8729caa-kube-api-access-q9jcc\") pod \"authorino-operator-657f44b778-4mnnl\" (UID: \"e0824d8c-073d-4600-b5e3-bd02f8729caa\") " pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:09.458545 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.458443    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:09.625033 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.624992    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4mnnl"]
Jun 03 15:58:09.628877 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:58:09.628847    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0824d8c_073d_4600_b5e3_bd02f8729caa.slice/crio-1576c028ef58d303cb532be67dac51892b51b32f0349825bd65ee9225c396645 WatchSource:0}: Error finding container 1576c028ef58d303cb532be67dac51892b51b32f0349825bd65ee9225c396645: Status 404 returned error can't find the container with id 1576c028ef58d303cb532be67dac51892b51b32f0349825bd65ee9225c396645
Jun 03 15:58:09.917356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:09.917319    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl" event={"ID":"e0824d8c-073d-4600-b5e3-bd02f8729caa","Type":"ContainerStarted","Data":"1576c028ef58d303cb532be67dac51892b51b32f0349825bd65ee9225c396645"}
Jun 03 15:58:12.371190 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.371150    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"]
Jun 03 15:58:12.374518 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.374491    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:12.378327 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.378305    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kfvmf\""
Jun 03 15:58:12.388896 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.388866    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"]
Jun 03 15:58:12.487711 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.487663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67bnj\" (UniqueName: \"kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj\") pod \"limitador-operator-controller-manager-85c4996f8c-d7xpt\" (UID: \"f0f058eb-65ee-4b6c-8f62-104ba676bb78\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:12.588178 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.588137    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67bnj\" (UniqueName: \"kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj\") pod \"limitador-operator-controller-manager-85c4996f8c-d7xpt\" (UID: \"f0f058eb-65ee-4b6c-8f62-104ba676bb78\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:12.601674 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.601644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67bnj\" (UniqueName: \"kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj\") pod \"limitador-operator-controller-manager-85c4996f8c-d7xpt\" (UID: \"f0f058eb-65ee-4b6c-8f62-104ba676bb78\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:12.684653 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.684560    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:12.840828 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.840801    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"]
Jun 03 15:58:12.843169 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:58:12.843137    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f058eb_65ee_4b6c_8f62_104ba676bb78.slice/crio-83095e39cfba28a05f418304f577748c1fd0ab1a695ddf804d30a0debb86e6e8 WatchSource:0}: Error finding container 83095e39cfba28a05f418304f577748c1fd0ab1a695ddf804d30a0debb86e6e8: Status 404 returned error can't find the container with id 83095e39cfba28a05f418304f577748c1fd0ab1a695ddf804d30a0debb86e6e8
Jun 03 15:58:12.930304 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.930261    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt" event={"ID":"f0f058eb-65ee-4b6c-8f62-104ba676bb78","Type":"ContainerStarted","Data":"83095e39cfba28a05f418304f577748c1fd0ab1a695ddf804d30a0debb86e6e8"}
Jun 03 15:58:12.931697 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.931667    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl" event={"ID":"e0824d8c-073d-4600-b5e3-bd02f8729caa","Type":"ContainerStarted","Data":"21ae92bb694e4e255b2399c13c62a92f14c527650e10cd5bd64133e213387dd6"}
Jun 03 15:58:12.931878 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.931862    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:12.958312 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:12.958114    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl" podStartSLOduration=1.693151255 podStartE2EDuration="3.958093563s" podCreationTimestamp="2026-06-03 15:58:09 +0000 UTC" firstStartedPulling="2026-06-03 15:58:09.631076827 +0000 UTC m=+551.349521934" lastFinishedPulling="2026-06-03 15:58:11.896019152 +0000 UTC m=+553.614464242" observedRunningTime="2026-06-03 15:58:12.956584999 +0000 UTC m=+554.675030111" watchObservedRunningTime="2026-06-03 15:58:12.958093563 +0000 UTC m=+554.676538677"
Jun 03 15:58:14.940278 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:14.940238    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt" event={"ID":"f0f058eb-65ee-4b6c-8f62-104ba676bb78","Type":"ContainerStarted","Data":"2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012"}
Jun 03 15:58:14.940674 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:14.940289    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:14.965128 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:14.965061    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt" podStartSLOduration=1.092604354 podStartE2EDuration="2.965042612s" podCreationTimestamp="2026-06-03 15:58:12 +0000 UTC" firstStartedPulling="2026-06-03 15:58:12.844990217 +0000 UTC m=+554.563435323" lastFinishedPulling="2026-06-03 15:58:14.717428491 +0000 UTC m=+556.435873581" observedRunningTime="2026-06-03 15:58:14.963533671 +0000 UTC m=+556.681978785" watchObservedRunningTime="2026-06-03 15:58:14.965042612 +0000 UTC m=+556.683487726"
Jun 03 15:58:18.914331 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:18.914291    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-www8w"
Jun 03 15:58:23.937533 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:23.937502    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-4mnnl"
Jun 03 15:58:25.947113 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:25.947078    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:35.983817 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:35.983777    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"]
Jun 03 15:58:35.987471 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:35.987450    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:35.989930 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:35.989909    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf8ch\""
Jun 03 15:58:36.000028 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:35.999994    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"]
Jun 03 15:58:36.094893 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.094852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.094893 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.094908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5jd\" (UniqueName: \"kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.195650 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.195597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5jd\" (UniqueName: \"kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.195833 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.195723    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.196175 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.196151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.205860 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.205824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5jd\" (UniqueName: \"kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.298437 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.298329    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:36.445868 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.445833    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"]
Jun 03 15:58:36.448908 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:58:36.448880    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf296af85_6cc1_418b_9ef7_45069244c4f8.slice/crio-342a67d25d9c38bb2ca374e532adb8e6197ca856d3e5c1518890b513dfb26add WatchSource:0}: Error finding container 342a67d25d9c38bb2ca374e532adb8e6197ca856d3e5c1518890b513dfb26add: Status 404 returned error can't find the container with id 342a67d25d9c38bb2ca374e532adb8e6197ca856d3e5c1518890b513dfb26add
Jun 03 15:58:36.711833 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.711790    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"]
Jun 03 15:58:36.719045 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.719010    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"]
Jun 03 15:58:36.731077 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.731041    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"]
Jun 03 15:58:36.731365 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.731298    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" containerName="manager" containerID="cri-o://2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012" gracePeriod=2
Jun 03 15:58:36.738519 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.738493    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"]
Jun 03 15:58:36.741189 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.741144    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:58:36.741951 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.741919    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" containerName="manager"
Jun 03 15:58:36.741951 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.741950    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" containerName="manager"
Jun 03 15:58:36.742091 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.742075    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" containerName="manager"
Jun 03 15:58:36.745622 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.745368    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.755797 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.755763    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:58:36.770338 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.770279    2562 status_manager.go:895] "Failed to get status for pod" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt" err="pods \"limitador-operator-controller-manager-85c4996f8c-d7xpt\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:36.801310 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.801141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgrx\" (UniqueName: \"kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.801310 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.801216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.902174 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.902061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.902363 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.902235    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgrx\" (UniqueName: \"kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.902772 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.902618    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.919356 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.919314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgrx\" (UniqueName: \"kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:36.990935 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:36.990907    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:37.003320 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.003287    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67bnj\" (UniqueName: \"kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj\") pod \"f0f058eb-65ee-4b6c-8f62-104ba676bb78\" (UID: \"f0f058eb-65ee-4b6c-8f62-104ba676bb78\") "
Jun 03 15:58:37.006147 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.006091    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj" (OuterVolumeSpecName: "kube-api-access-67bnj") pod "f0f058eb-65ee-4b6c-8f62-104ba676bb78" (UID: "f0f058eb-65ee-4b6c-8f62-104ba676bb78"). InnerVolumeSpecName "kube-api-access-67bnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:58:37.022716 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.022670    2562 generic.go:358] "Generic (PLEG): container finished" podID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" containerID="2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012" exitCode=0
Jun 03 15:58:37.022912 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.022735    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d7xpt"
Jun 03 15:58:37.023030 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.022744    2562 scope.go:117] "RemoveContainer" containerID="2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012"
Jun 03 15:58:37.034992 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.034930    2562 scope.go:117] "RemoveContainer" containerID="2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012"
Jun 03 15:58:37.035415 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:58:37.035389    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012\": container with ID starting with 2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012 not found: ID does not exist" containerID="2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012"
Jun 03 15:58:37.035508 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.035429    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012"} err="failed to get container status \"2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012\": rpc error: code = NotFound desc = could not find container \"2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012\": container with ID starting with 2350061907e134e88b490bc9f74f833e314d104173308cc306d1faaaf1168012 not found: ID does not exist"
Jun 03 15:58:37.104067 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.104036    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67bnj\" (UniqueName: \"kubernetes.io/projected/f0f058eb-65ee-4b6c-8f62-104ba676bb78-kube-api-access-67bnj\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:58:37.104789 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.104769    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:37.269175 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:37.269149    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:58:37.271615 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:58:37.271585    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dd9a60_c905_4918_bf4e_2c0edf9785be.slice/crio-36c33f789fd1053eed943b3c04872c986a8b07264f2d87aae4f6655a5fa997fa WatchSource:0}: Error finding container 36c33f789fd1053eed943b3c04872c986a8b07264f2d87aae4f6655a5fa997fa: Status 404 returned error can't find the container with id 36c33f789fd1053eed943b3c04872c986a8b07264f2d87aae4f6655a5fa997fa
Jun 03 15:58:38.028759 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:38.028710    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" event={"ID":"92dd9a60-c905-4918-bf4e-2c0edf9785be","Type":"ContainerStarted","Data":"36c33f789fd1053eed943b3c04872c986a8b07264f2d87aae4f6655a5fa997fa"}
Jun 03 15:58:38.827430 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:38.827392    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f058eb-65ee-4b6c-8f62-104ba676bb78" path="/var/lib/kubelet/pods/f0f058eb-65ee-4b6c-8f62-104ba676bb78/volumes"
Jun 03 15:58:41.043439 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.043365    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" containerName="manager" containerID="cri-o://b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9" gracePeriod=2
Jun 03 15:58:41.045087 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.045053    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" event={"ID":"92dd9a60-c905-4918-bf4e-2c0edf9785be","Type":"ContainerStarted","Data":"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"}
Jun 03 15:58:41.045242 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.045211    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:41.045507 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.045476    2562 status_manager.go:895] "Failed to get status for pod" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:41.069093 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.069047    2562 status_manager.go:895] "Failed to get status for pod" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:41.069814 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.069754    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" podStartSLOduration=1.74171582 podStartE2EDuration="5.069736862s" podCreationTimestamp="2026-06-03 15:58:36 +0000 UTC" firstStartedPulling="2026-06-03 15:58:37.27426184 +0000 UTC m=+578.992706932" lastFinishedPulling="2026-06-03 15:58:40.602282879 +0000 UTC m=+582.320727974" observedRunningTime="2026-06-03 15:58:41.066958021 +0000 UTC m=+582.785403136" watchObservedRunningTime="2026-06-03 15:58:41.069736862 +0000 UTC m=+582.788181976"
Jun 03 15:58:41.281756 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.281730    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:41.284218 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.284191    2562 status_manager.go:895] "Failed to get status for pod" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:41.346000 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.345941    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume\") pod \"f296af85-6cc1-418b-9ef7-45069244c4f8\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") "
Jun 03 15:58:41.346175 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.346023    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng5jd\" (UniqueName: \"kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd\") pod \"f296af85-6cc1-418b-9ef7-45069244c4f8\" (UID: \"f296af85-6cc1-418b-9ef7-45069244c4f8\") "
Jun 03 15:58:41.346261 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.346234    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f296af85-6cc1-418b-9ef7-45069244c4f8" (UID: "f296af85-6cc1-418b-9ef7-45069244c4f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 15:58:41.348250 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.348230    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd" (OuterVolumeSpecName: "kube-api-access-ng5jd") pod "f296af85-6cc1-418b-9ef7-45069244c4f8" (UID: "f296af85-6cc1-418b-9ef7-45069244c4f8"). InnerVolumeSpecName "kube-api-access-ng5jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:58:41.447647 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.447600    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f296af85-6cc1-418b-9ef7-45069244c4f8-extensions-socket-volume\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:58:41.447647 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:41.447638    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng5jd\" (UniqueName: \"kubernetes.io/projected/f296af85-6cc1-418b-9ef7-45069244c4f8-kube-api-access-ng5jd\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:58:42.049843 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.049735    2562 generic.go:358] "Generic (PLEG): container finished" podID="f296af85-6cc1-418b-9ef7-45069244c4f8" containerID="b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9" exitCode=2
Jun 03 15:58:42.049843 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.049798    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28"
Jun 03 15:58:42.050383 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.049851    2562 scope.go:117] "RemoveContainer" containerID="b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9"
Jun 03 15:58:42.052238 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.052208    2562 status_manager.go:895] "Failed to get status for pod" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:42.059681 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.059657    2562 scope.go:117] "RemoveContainer" containerID="b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9"
Jun 03 15:58:42.060011 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:58:42.059968    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9\": container with ID starting with b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9 not found: ID does not exist" containerID="b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9"
Jun 03 15:58:42.060093 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.060024    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9"} err="failed to get container status \"b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9\": rpc error: code = NotFound desc = could not find container \"b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9\": container with ID starting with b12d6b03baac39f845da100326a9aef2385827d2bb68a7a0aa328d51a38bc6e9 not found: ID does not exist"
Jun 03 15:58:42.060755 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.060734    2562 status_manager.go:895] "Failed to get status for pod" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-4db28" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-4db28\" is forbidden: User \"system:node:ip-10-0-135-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-102.ec2.internal' and this object"
Jun 03 15:58:42.824803 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:42.824769    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" path="/var/lib/kubelet/pods/f296af85-6cc1-418b-9ef7-45069244c4f8/volumes"
Jun 03 15:58:52.053151 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:52.053116    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:58:58.765559 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:58.765531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:58:58.766025 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:58.765533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 15:58:58.773073 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:58.773047    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:58:58.773413 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:58:58.773377    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 15:59:04.249449 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.249405    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:59:04.249873 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.249713    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" podUID="92dd9a60-c905-4918-bf4e-2c0edf9785be" containerName="manager" containerID="cri-o://87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2" gracePeriod=10
Jun 03 15:59:04.517169 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.517143    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:59:04.653329 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.653289    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume\") pod \"92dd9a60-c905-4918-bf4e-2c0edf9785be\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") "
Jun 03 15:59:04.653506 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.653404    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxgrx\" (UniqueName: \"kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx\") pod \"92dd9a60-c905-4918-bf4e-2c0edf9785be\" (UID: \"92dd9a60-c905-4918-bf4e-2c0edf9785be\") "
Jun 03 15:59:04.653782 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.653743    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "92dd9a60-c905-4918-bf4e-2c0edf9785be" (UID: "92dd9a60-c905-4918-bf4e-2c0edf9785be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 15:59:04.655746 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.655708    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx" (OuterVolumeSpecName: "kube-api-access-jxgrx") pod "92dd9a60-c905-4918-bf4e-2c0edf9785be" (UID: "92dd9a60-c905-4918-bf4e-2c0edf9785be"). InnerVolumeSpecName "kube-api-access-jxgrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:59:04.754618 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.754515    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxgrx\" (UniqueName: \"kubernetes.io/projected/92dd9a60-c905-4918-bf4e-2c0edf9785be-kube-api-access-jxgrx\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:59:04.754618 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:04.754556    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92dd9a60-c905-4918-bf4e-2c0edf9785be-extensions-socket-volume\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:59:05.141781 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.141730    2562 generic.go:358] "Generic (PLEG): container finished" podID="92dd9a60-c905-4918-bf4e-2c0edf9785be" containerID="87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2" exitCode=0
Jun 03 15:59:05.141941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.141817    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" event={"ID":"92dd9a60-c905-4918-bf4e-2c0edf9785be","Type":"ContainerDied","Data":"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"}
Jun 03 15:59:05.141941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.141840    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"
Jun 03 15:59:05.141941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.141866    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9" event={"ID":"92dd9a60-c905-4918-bf4e-2c0edf9785be","Type":"ContainerDied","Data":"36c33f789fd1053eed943b3c04872c986a8b07264f2d87aae4f6655a5fa997fa"}
Jun 03 15:59:05.141941 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.141882    2562 scope.go:117] "RemoveContainer" containerID="87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"
Jun 03 15:59:05.150817 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.150797    2562 scope.go:117] "RemoveContainer" containerID="87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"
Jun 03 15:59:05.151150 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:59:05.151122    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2\": container with ID starting with 87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2 not found: ID does not exist" containerID="87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"
Jun 03 15:59:05.151283 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.151155    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2"} err="failed to get container status \"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2\": rpc error: code = NotFound desc = could not find container \"87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2\": container with ID starting with 87d80b98740d45bc41dbb5a8147638d7cd8e97c7dc72711bb8c72a40db1ab8f2 not found: ID does not exist"
Jun 03 15:59:05.169762 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.169714    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:59:05.174161 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:05.174122    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-dj9n9"]
Jun 03 15:59:06.825277 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:06.825241    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92dd9a60-c905-4918-bf4e-2c0edf9785be" path="/var/lib/kubelet/pods/92dd9a60-c905-4918-bf4e-2c0edf9785be/volumes"
Jun 03 15:59:08.514675 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.514631    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"]
Jun 03 15:59:08.515166 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515117    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92dd9a60-c905-4918-bf4e-2c0edf9785be" containerName="manager"
Jun 03 15:59:08.515166 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515132    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="92dd9a60-c905-4918-bf4e-2c0edf9785be" containerName="manager"
Jun 03 15:59:08.515166 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" containerName="manager"
Jun 03 15:59:08.515166 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515147    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" containerName="manager"
Jun 03 15:59:08.515366 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515229    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="92dd9a60-c905-4918-bf4e-2c0edf9785be" containerName="manager"
Jun 03 15:59:08.515366 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.515243    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f296af85-6cc1-418b-9ef7-45069244c4f8" containerName="manager"
Jun 03 15:59:08.518462 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.518437    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.522709 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.522685    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rlvwr\""
Jun 03 15:59:08.533103 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.533067    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"]
Jun 03 15:59:08.690197 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690391 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690391 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93206ff-08b7-4215-a923-81ca69e93ae8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690391 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690593 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690593 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgl9t\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-kube-api-access-zgl9t\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690593 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690593 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.690593 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.690563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791329    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791429 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791376    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791718 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791511    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93206ff-08b7-4215-a923-81ca69e93ae8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791718 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791571    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791718 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791608    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791718 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791634    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgl9t\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-kube-api-access-zgl9t\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791718 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791692    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791966 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791744    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791966 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791821    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.791966 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.792222 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791969    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.792222 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.791744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.792222 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.792188    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.792344 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.792259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93206ff-08b7-4215-a923-81ca69e93ae8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.794020 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.793999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.794171 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.794156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.804385 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.804348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.804544 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.804411    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgl9t\" (UniqueName: \"kubernetes.io/projected/a93206ff-08b7-4215-a923-81ca69e93ae8-kube-api-access-zgl9t\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-245cv\" (UID: \"a93206ff-08b7-4215-a923-81ca69e93ae8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.831629 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.831582    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:08.989494 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.989363    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"]
Jun 03 15:59:08.991878 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:59:08.991848    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93206ff_08b7_4215_a923_81ca69e93ae8.slice/crio-a91b73bc174d8ae7894dea0d01fb206bd10ea66bfabc1b9247bda6df7d712e30 WatchSource:0}: Error finding container a91b73bc174d8ae7894dea0d01fb206bd10ea66bfabc1b9247bda6df7d712e30: Status 404 returned error can't find the container with id a91b73bc174d8ae7894dea0d01fb206bd10ea66bfabc1b9247bda6df7d712e30
Jun 03 15:59:08.993991 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.993944    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:59:08.994064 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.994044    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:59:08.994104 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:08.994075    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jun 03 15:59:09.159754 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:09.159713    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv" event={"ID":"a93206ff-08b7-4215-a923-81ca69e93ae8","Type":"ContainerStarted","Data":"6bd3c526c8a8680ded28a3bbc2a3e4192477d41498dcd85841d08915ffd6f040"}
Jun 03 15:59:09.159754 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:09.159760    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv" event={"ID":"a93206ff-08b7-4215-a923-81ca69e93ae8","Type":"ContainerStarted","Data":"a91b73bc174d8ae7894dea0d01fb206bd10ea66bfabc1b9247bda6df7d712e30"}
Jun 03 15:59:09.187434 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:09.187362    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv" podStartSLOduration=1.18733981 podStartE2EDuration="1.18733981s" podCreationTimestamp="2026-06-03 15:59:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:59:09.184703691 +0000 UTC m=+610.903148803" watchObservedRunningTime="2026-06-03 15:59:09.18733981 +0000 UTC m=+610.905784924"
Jun 03 15:59:09.832484 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:09.832440    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:10.837651 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:10.837614    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:11.166399 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:11.166366    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:11.167428 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:11.167408    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-245cv"
Jun 03 15:59:20.174785 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.174742    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:20.178252 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.178228    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.180628 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.180603    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 15:59:20.180757 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.180604    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhv64\""
Jun 03 15:59:20.189838 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.189809    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:20.192178 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.192149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.192323 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.192197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj6nx\" (UniqueName: \"kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.279500 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.279462    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:20.293362 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.293325    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.293564 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.293442    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qj6nx\" (UniqueName: \"kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.294201 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.294171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.304801 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.304759    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj6nx\" (UniqueName: \"kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx\") pod \"limitador-limitador-7d549b5b-ksk2s\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.490118 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.490025    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:20.660419 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:20.660388    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:20.662915 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:59:20.662876    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fb396e_8483_4c1e_b7b7_3edaa5d58345.slice/crio-b88db13e7f9416bc3c43032f23dbf89c8a37b1930bbbf63d2220734b6170622b WatchSource:0}: Error finding container b88db13e7f9416bc3c43032f23dbf89c8a37b1930bbbf63d2220734b6170622b: Status 404 returned error can't find the container with id b88db13e7f9416bc3c43032f23dbf89c8a37b1930bbbf63d2220734b6170622b
Jun 03 15:59:21.085120 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.085069    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:21.090458 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.090429    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:21.093839 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.093811    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8r5lr\""
Jun 03 15:59:21.100160 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.100131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjzsl\" (UniqueName: \"kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl\") pod \"authorino-f99f4b5cd-d8hcr\" (UID: \"43078183-b716-493a-951a-536c868e47c5\") " pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:21.101219 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.101193    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:21.200657 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.200618    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjzsl\" (UniqueName: \"kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl\") pod \"authorino-f99f4b5cd-d8hcr\" (UID: \"43078183-b716-493a-951a-536c868e47c5\") " pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:21.203088 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.203053    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" event={"ID":"62fb396e-8483-4c1e-b7b7-3edaa5d58345","Type":"ContainerStarted","Data":"b88db13e7f9416bc3c43032f23dbf89c8a37b1930bbbf63d2220734b6170622b"}
Jun 03 15:59:21.212470 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.212447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjzsl\" (UniqueName: \"kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl\") pod \"authorino-f99f4b5cd-d8hcr\" (UID: \"43078183-b716-493a-951a-536c868e47c5\") " pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:21.349596 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.349554    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 15:59:21.353512 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.353476    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 15:59:21.360945 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.360910    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 15:59:21.400592 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.400550    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:21.403421 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.403357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh9vj\" (UniqueName: \"kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj\") pod \"authorino-7498df8756-rrvd6\" (UID: \"e7285ae4-18d5-4c9a-accb-c231edce2886\") " pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 15:59:21.504831 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.504727    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh9vj\" (UniqueName: \"kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj\") pod \"authorino-7498df8756-rrvd6\" (UID: \"e7285ae4-18d5-4c9a-accb-c231edce2886\") " pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 15:59:21.519735 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.517321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh9vj\" (UniqueName: \"kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj\") pod \"authorino-7498df8756-rrvd6\" (UID: \"e7285ae4-18d5-4c9a-accb-c231edce2886\") " pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 15:59:21.590134 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.589909    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:21.593371 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:59:21.593336    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43078183_b716_493a_951a_536c868e47c5.slice/crio-8883d04ed080b29f2a5de17db9d0809159d5c325ee74268ce2ab147c1967fa2d WatchSource:0}: Error finding container 8883d04ed080b29f2a5de17db9d0809159d5c325ee74268ce2ab147c1967fa2d: Status 404 returned error can't find the container with id 8883d04ed080b29f2a5de17db9d0809159d5c325ee74268ce2ab147c1967fa2d
Jun 03 15:59:21.676640 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.676521    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 15:59:21.843479 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:21.843448    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 15:59:21.847273 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:59:21.847235    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7285ae4_18d5_4c9a_accb_c231edce2886.slice/crio-f5e4a940d124bdf72653524d58a484fc40224fbbe40c947793f0d8461b8d9368 WatchSource:0}: Error finding container f5e4a940d124bdf72653524d58a484fc40224fbbe40c947793f0d8461b8d9368: Status 404 returned error can't find the container with id f5e4a940d124bdf72653524d58a484fc40224fbbe40c947793f0d8461b8d9368
Jun 03 15:59:22.212284 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:22.212239    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rrvd6" event={"ID":"e7285ae4-18d5-4c9a-accb-c231edce2886","Type":"ContainerStarted","Data":"f5e4a940d124bdf72653524d58a484fc40224fbbe40c947793f0d8461b8d9368"}
Jun 03 15:59:22.213568 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:22.213535    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" event={"ID":"43078183-b716-493a-951a-536c868e47c5","Type":"ContainerStarted","Data":"8883d04ed080b29f2a5de17db9d0809159d5c325ee74268ce2ab147c1967fa2d"}
Jun 03 15:59:26.233154 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.233112    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" event={"ID":"43078183-b716-493a-951a-536c868e47c5","Type":"ContainerStarted","Data":"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"}
Jun 03 15:59:26.234640 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.234607    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" event={"ID":"62fb396e-8483-4c1e-b7b7-3edaa5d58345","Type":"ContainerStarted","Data":"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"}
Jun 03 15:59:26.234793 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.234689    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:26.235932 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.235909    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rrvd6" event={"ID":"e7285ae4-18d5-4c9a-accb-c231edce2886","Type":"ContainerStarted","Data":"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"}
Jun 03 15:59:26.250481 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.250426    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" podStartSLOduration=1.120576202 podStartE2EDuration="5.250404998s" podCreationTimestamp="2026-06-03 15:59:21 +0000 UTC" firstStartedPulling="2026-06-03 15:59:21.595764652 +0000 UTC m=+623.314209760" lastFinishedPulling="2026-06-03 15:59:25.725593451 +0000 UTC m=+627.444038556" observedRunningTime="2026-06-03 15:59:26.248947295 +0000 UTC m=+627.967392409" watchObservedRunningTime="2026-06-03 15:59:26.250404998 +0000 UTC m=+627.968850110"
Jun 03 15:59:26.267323 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.267272    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" podStartSLOduration=1.274214777 podStartE2EDuration="6.267254971s" podCreationTimestamp="2026-06-03 15:59:20 +0000 UTC" firstStartedPulling="2026-06-03 15:59:20.665025398 +0000 UTC m=+622.383470489" lastFinishedPulling="2026-06-03 15:59:25.658065579 +0000 UTC m=+627.376510683" observedRunningTime="2026-06-03 15:59:26.265791758 +0000 UTC m=+627.984236853" watchObservedRunningTime="2026-06-03 15:59:26.267254971 +0000 UTC m=+627.985700084"
Jun 03 15:59:26.282848 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.282791    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-rrvd6" podStartSLOduration=1.392935376 podStartE2EDuration="5.282775692s" podCreationTimestamp="2026-06-03 15:59:21 +0000 UTC" firstStartedPulling="2026-06-03 15:59:21.849202524 +0000 UTC m=+623.567647621" lastFinishedPulling="2026-06-03 15:59:25.739042831 +0000 UTC m=+627.457487937" observedRunningTime="2026-06-03 15:59:26.281400302 +0000 UTC m=+627.999845418" watchObservedRunningTime="2026-06-03 15:59:26.282775692 +0000 UTC m=+628.001220804"
Jun 03 15:59:26.315881 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:26.315841    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:28.242861 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:28.242799    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" podUID="43078183-b716-493a-951a-536c868e47c5" containerName="authorino" containerID="cri-o://9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc" gracePeriod=30
Jun 03 15:59:28.508665 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:28.508639    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:28.575281 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:28.575248    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjzsl\" (UniqueName: \"kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl\") pod \"43078183-b716-493a-951a-536c868e47c5\" (UID: \"43078183-b716-493a-951a-536c868e47c5\") "
Jun 03 15:59:28.577440 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:28.577407    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl" (OuterVolumeSpecName: "kube-api-access-rjzsl") pod "43078183-b716-493a-951a-536c868e47c5" (UID: "43078183-b716-493a-951a-536c868e47c5"). InnerVolumeSpecName "kube-api-access-rjzsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:59:28.676286 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:28.676239    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjzsl\" (UniqueName: \"kubernetes.io/projected/43078183-b716-493a-951a-536c868e47c5-kube-api-access-rjzsl\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:59:29.247213 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.247175    2562 generic.go:358] "Generic (PLEG): container finished" podID="43078183-b716-493a-951a-536c868e47c5" containerID="9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc" exitCode=0
Jun 03 15:59:29.247692 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.247219    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr"
Jun 03 15:59:29.247692 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.247265    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" event={"ID":"43078183-b716-493a-951a-536c868e47c5","Type":"ContainerDied","Data":"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"}
Jun 03 15:59:29.247692 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.247305    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-d8hcr" event={"ID":"43078183-b716-493a-951a-536c868e47c5","Type":"ContainerDied","Data":"8883d04ed080b29f2a5de17db9d0809159d5c325ee74268ce2ab147c1967fa2d"}
Jun 03 15:59:29.247692 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.247326    2562 scope.go:117] "RemoveContainer" containerID="9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"
Jun 03 15:59:29.256067 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.256032    2562 scope.go:117] "RemoveContainer" containerID="9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"
Jun 03 15:59:29.256355 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:59:29.256336    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc\": container with ID starting with 9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc not found: ID does not exist" containerID="9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"
Jun 03 15:59:29.256403 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.256364    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc"} err="failed to get container status \"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc\": rpc error: code = NotFound desc = could not find container \"9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc\": container with ID starting with 9e96df55639424dfa5ae0133035c70d1401962408c8f0871193fa800be04c5fc not found: ID does not exist"
Jun 03 15:59:29.266295 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.266262    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:29.271393 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:29.271366    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-d8hcr"]
Jun 03 15:59:30.826177 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:30.826140    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43078183-b716-493a-951a-536c868e47c5" path="/var/lib/kubelet/pods/43078183-b716-493a-951a-536c868e47c5/volumes"
Jun 03 15:59:35.398068 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:35.398027    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:35.398582 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:35.398361    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" podUID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" containerName="limitador" containerID="cri-o://23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a" gracePeriod=30
Jun 03 15:59:35.399180 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:35.399123    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:35.963800 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:35.963716    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:36.041591 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.041543    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj6nx\" (UniqueName: \"kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx\") pod \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") "
Jun 03 15:59:36.041768 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.041603    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file\") pod \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\" (UID: \"62fb396e-8483-4c1e-b7b7-3edaa5d58345\") "
Jun 03 15:59:36.042062 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.042036    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file" (OuterVolumeSpecName: "config-file") pod "62fb396e-8483-4c1e-b7b7-3edaa5d58345" (UID: "62fb396e-8483-4c1e-b7b7-3edaa5d58345"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 15:59:36.043843 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.043813    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx" (OuterVolumeSpecName: "kube-api-access-qj6nx") pod "62fb396e-8483-4c1e-b7b7-3edaa5d58345" (UID: "62fb396e-8483-4c1e-b7b7-3edaa5d58345"). InnerVolumeSpecName "kube-api-access-qj6nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:59:36.142423 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.142381    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj6nx\" (UniqueName: \"kubernetes.io/projected/62fb396e-8483-4c1e-b7b7-3edaa5d58345-kube-api-access-qj6nx\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:59:36.142423 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.142421    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62fb396e-8483-4c1e-b7b7-3edaa5d58345-config-file\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 15:59:36.277305 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.277213    2562 generic.go:358] "Generic (PLEG): container finished" podID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" containerID="23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a" exitCode=0
Jun 03 15:59:36.277305 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.277254    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" event={"ID":"62fb396e-8483-4c1e-b7b7-3edaa5d58345","Type":"ContainerDied","Data":"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"}
Jun 03 15:59:36.277305 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.277271    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s"
Jun 03 15:59:36.277305 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.277287    2562 scope.go:117] "RemoveContainer" containerID="23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"
Jun 03 15:59:36.277618 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.277276    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ksk2s" event={"ID":"62fb396e-8483-4c1e-b7b7-3edaa5d58345","Type":"ContainerDied","Data":"b88db13e7f9416bc3c43032f23dbf89c8a37b1930bbbf63d2220734b6170622b"}
Jun 03 15:59:36.287061 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.287038    2562 scope.go:117] "RemoveContainer" containerID="23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"
Jun 03 15:59:36.287376 ip-10-0-135-102 kubenswrapper[2562]: E0603 15:59:36.287355    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a\": container with ID starting with 23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a not found: ID does not exist" containerID="23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"
Jun 03 15:59:36.287440 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.287386    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a"} err="failed to get container status \"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a\": rpc error: code = NotFound desc = could not find container \"23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a\": container with ID starting with 23c9e7e639dc1f42852596a38fad5714c27912b278c5d2e3498a404b22891d7a not found: ID does not exist"
Jun 03 15:59:36.306887 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.306843    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:36.309885 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.309855    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ksk2s"]
Jun 03 15:59:36.825755 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:36.825720    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" path="/var/lib/kubelet/pods/62fb396e-8483-4c1e-b7b7-3edaa5d58345/volumes"
Jun 03 15:59:39.268797 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.268759    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-n7clm"]
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43078183-b716-493a-951a-536c868e47c5" containerName="authorino"
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269155    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="43078183-b716-493a-951a-536c868e47c5" containerName="authorino"
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269177    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" containerName="limitador"
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269183    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" containerName="limitador"
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269240    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="62fb396e-8483-4c1e-b7b7-3edaa5d58345" containerName="limitador"
Jun 03 15:59:39.271185 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.269249    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="43078183-b716-493a-951a-536c868e47c5" containerName="authorino"
Jun 03 15:59:39.272277 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.272258    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.275129 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.275100    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 03 15:59:39.288684 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.288653    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-n7clm"]
Jun 03 15:59:39.373746 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.373698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbwzk\" (UniqueName: \"kubernetes.io/projected/3e6ddb36-d74c-429e-b8a3-3b45808ce531-kube-api-access-wbwzk\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.373931 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.373764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e6ddb36-d74c-429e-b8a3-3b45808ce531-data\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.475197 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.475152    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbwzk\" (UniqueName: \"kubernetes.io/projected/3e6ddb36-d74c-429e-b8a3-3b45808ce531-kube-api-access-wbwzk\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.475373 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.475204    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e6ddb36-d74c-429e-b8a3-3b45808ce531-data\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.475566 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.475548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e6ddb36-d74c-429e-b8a3-3b45808ce531-data\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.486233 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.486196    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbwzk\" (UniqueName: \"kubernetes.io/projected/3e6ddb36-d74c-429e-b8a3-3b45808ce531-kube-api-access-wbwzk\") pod \"postgres-68c4fbbd6f-n7clm\" (UID: \"3e6ddb36-d74c-429e-b8a3-3b45808ce531\") " pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.583121 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.583019    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:39.726613 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:39.726584    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-n7clm"]
Jun 03 15:59:39.729324 ip-10-0-135-102 kubenswrapper[2562]: W0603 15:59:39.729289    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6ddb36_d74c_429e_b8a3_3b45808ce531.slice/crio-97c60cecbe2e2b3d4b0450fbbc307d4ab369f1853b2f6c928907beadc153e8e0 WatchSource:0}: Error finding container 97c60cecbe2e2b3d4b0450fbbc307d4ab369f1853b2f6c928907beadc153e8e0: Status 404 returned error can't find the container with id 97c60cecbe2e2b3d4b0450fbbc307d4ab369f1853b2f6c928907beadc153e8e0
Jun 03 15:59:40.293565 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:40.293522    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-n7clm" event={"ID":"3e6ddb36-d74c-429e-b8a3-3b45808ce531","Type":"ContainerStarted","Data":"97c60cecbe2e2b3d4b0450fbbc307d4ab369f1853b2f6c928907beadc153e8e0"}
Jun 03 15:59:45.319427 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:45.319386    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-n7clm" event={"ID":"3e6ddb36-d74c-429e-b8a3-3b45808ce531","Type":"ContainerStarted","Data":"611cf2075839956d49564395aa719280ebb0853f71077a2762256324b7968d85"}
Jun 03 15:59:45.319817 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:45.319507    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 15:59:45.340375 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:45.340309    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-n7clm" podStartSLOduration=1.568476346 podStartE2EDuration="6.340292248s" podCreationTimestamp="2026-06-03 15:59:39 +0000 UTC" firstStartedPulling="2026-06-03 15:59:39.73070819 +0000 UTC m=+641.449153280" lastFinishedPulling="2026-06-03 15:59:44.502524087 +0000 UTC m=+646.220969182" observedRunningTime="2026-06-03 15:59:45.338701797 +0000 UTC m=+647.057146915" watchObservedRunningTime="2026-06-03 15:59:45.340292248 +0000 UTC m=+647.058737361"
Jun 03 15:59:51.353654 ip-10-0-135-102 kubenswrapper[2562]: I0603 15:59:51.353619    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-n7clm"
Jun 03 16:00:00.070347 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.070306    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5k2v2"]
Jun 03 16:00:00.080198 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.080169    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2"
Jun 03 16:00:00.083392 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.083357    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 16:00:00.084160 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.084108    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 16:00:00.084640 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.084615    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-g87tt\""
Jun 03 16:00:00.085434 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.085410    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5k2v2"]
Jun 03 16:00:00.161363 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.161319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njvq8\" (UniqueName: \"kubernetes.io/projected/39c030fe-eae3-48c2-ad41-9b4777423c92-kube-api-access-njvq8\") pod \"keycloak-operator-7864d68cbd-5k2v2\" (UID: \"39c030fe-eae3-48c2-ad41-9b4777423c92\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2"
Jun 03 16:00:00.262098 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.262057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njvq8\" (UniqueName: \"kubernetes.io/projected/39c030fe-eae3-48c2-ad41-9b4777423c92-kube-api-access-njvq8\") pod \"keycloak-operator-7864d68cbd-5k2v2\" (UID: \"39c030fe-eae3-48c2-ad41-9b4777423c92\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2"
Jun 03 16:00:00.272506 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.272465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njvq8\" (UniqueName: \"kubernetes.io/projected/39c030fe-eae3-48c2-ad41-9b4777423c92-kube-api-access-njvq8\") pod \"keycloak-operator-7864d68cbd-5k2v2\" (UID: \"39c030fe-eae3-48c2-ad41-9b4777423c92\") " pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2"
Jun 03 16:00:00.393689 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.393647    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2"
Jun 03 16:00:00.538092 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:00.538047    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-5k2v2"]
Jun 03 16:00:00.542574 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:00:00.542529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c030fe_eae3_48c2_ad41_9b4777423c92.slice/crio-b39f6a7bc83ca4e1652b07b7ec7fe6b561d74fa311d34e156c38a535f949c682 WatchSource:0}: Error finding container b39f6a7bc83ca4e1652b07b7ec7fe6b561d74fa311d34e156c38a535f949c682: Status 404 returned error can't find the container with id b39f6a7bc83ca4e1652b07b7ec7fe6b561d74fa311d34e156c38a535f949c682
Jun 03 16:00:01.383544 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:01.383484    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2" event={"ID":"39c030fe-eae3-48c2-ad41-9b4777423c92","Type":"ContainerStarted","Data":"b39f6a7bc83ca4e1652b07b7ec7fe6b561d74fa311d34e156c38a535f949c682"}
Jun 03 16:00:07.409107 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:07.409057    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2" event={"ID":"39c030fe-eae3-48c2-ad41-9b4777423c92","Type":"ContainerStarted","Data":"8739566409c4ad081da7b2bd439761ef674747f7df375a35fc59c4a2e628d350"}
Jun 03 16:00:07.427631 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:07.427561    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-5k2v2" podStartSLOduration=1.236687115 podStartE2EDuration="7.427541261s" podCreationTimestamp="2026-06-03 16:00:00 +0000 UTC" firstStartedPulling="2026-06-03 16:00:00.544151311 +0000 UTC m=+662.262596420" lastFinishedPulling="2026-06-03 16:00:06.735005475 +0000 UTC m=+668.453450566" observedRunningTime="2026-06-03 16:00:07.426025717 +0000 UTC m=+669.144470832" watchObservedRunningTime="2026-06-03 16:00:07.427541261 +0000 UTC m=+669.145986375"
Jun 03 16:00:45.788590 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.788503    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:45.796438 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.796406    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:45.800196 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.800159    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:45.885992 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.885936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c4kd\" (UniqueName: \"kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd\") pod \"authorino-8b475cf9f-tlf69\" (UID: \"2c454b31-62df-4148-9d4f-c72d70f908e7\") " pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:45.987091 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.987046    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c4kd\" (UniqueName: \"kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd\") pod \"authorino-8b475cf9f-tlf69\" (UID: \"2c454b31-62df-4148-9d4f-c72d70f908e7\") " pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:45.996678 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:45.996642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c4kd\" (UniqueName: \"kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd\") pod \"authorino-8b475cf9f-tlf69\" (UID: \"2c454b31-62df-4148-9d4f-c72d70f908e7\") " pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:46.025644 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.025605    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:46.026004 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.025966    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:46.055644 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.055554    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:46.059146 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.059122    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:46.067344 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.066829    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:46.176548 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.176518    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:46.178742 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:00:46.178708    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c454b31_62df_4148_9d4f_c72d70f908e7.slice/crio-ff7907ca4ea4bf8ff48278ef9d7b6f89a2f47ef750c8ee0ed9900b247922e4f0 WatchSource:0}: Error finding container ff7907ca4ea4bf8ff48278ef9d7b6f89a2f47ef750c8ee0ed9900b247922e4f0: Status 404 returned error can't find the container with id ff7907ca4ea4bf8ff48278ef9d7b6f89a2f47ef750c8ee0ed9900b247922e4f0
Jun 03 16:00:46.189272 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.189229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjnp\" (UniqueName: \"kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp\") pod \"authorino-5b6d78449c-txg9g\" (UID: \"4e4a4f5d-f987-4b52-a32c-9e9837139423\") " pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:46.290449 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.290405    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjnp\" (UniqueName: \"kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp\") pod \"authorino-5b6d78449c-txg9g\" (UID: \"4e4a4f5d-f987-4b52-a32c-9e9837139423\") " pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:46.300252 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.300223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjnp\" (UniqueName: \"kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp\") pod \"authorino-5b6d78449c-txg9g\" (UID: \"4e4a4f5d-f987-4b52-a32c-9e9837139423\") " pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:46.373745 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.373712    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:46.522347 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.522316    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:46.524866 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:00:46.524829    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e4a4f5d_f987_4b52_a32c_9e9837139423.slice/crio-ee110c484c94523cca6f48ea7f031d4c3b1ebb0a0c6e8130723fd5e00622fc4b WatchSource:0}: Error finding container ee110c484c94523cca6f48ea7f031d4c3b1ebb0a0c6e8130723fd5e00622fc4b: Status 404 returned error can't find the container with id ee110c484c94523cca6f48ea7f031d4c3b1ebb0a0c6e8130723fd5e00622fc4b
Jun 03 16:00:46.555521 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.555481    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6d78449c-txg9g" event={"ID":"4e4a4f5d-f987-4b52-a32c-9e9837139423","Type":"ContainerStarted","Data":"ee110c484c94523cca6f48ea7f031d4c3b1ebb0a0c6e8130723fd5e00622fc4b"}
Jun 03 16:00:46.556540 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.556511    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-tlf69" event={"ID":"2c454b31-62df-4148-9d4f-c72d70f908e7","Type":"ContainerStarted","Data":"ff7907ca4ea4bf8ff48278ef9d7b6f89a2f47ef750c8ee0ed9900b247922e4f0"}
Jun 03 16:00:46.695305 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.695209    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:46.722872 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.722833    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:00:46.725326 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.725308    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:46.727856 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.727833    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 03 16:00:46.735341 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.735310    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:00:46.896224 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.896193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9w7m\" (UniqueName: \"kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:46.896544 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.896236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:46.997485 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.997381    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9w7m\" (UniqueName: \"kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:46.997485 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:46.997447    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:47.000352 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.000325    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:47.008687 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.008657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9w7m\" (UniqueName: \"kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m\") pod \"authorino-557768694f-qqbq2\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") " pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:47.035195 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.035151    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:00:47.204308 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.204282    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:00:47.206474 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:00:47.206437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod954c8ac6_b4f9_4a24_9c57_4c27e7e1413a.slice/crio-4744d0fabfdb79c88676a75e6b73c1a7378fc8d13aab8e7a47569c88b406c476 WatchSource:0}: Error finding container 4744d0fabfdb79c88676a75e6b73c1a7378fc8d13aab8e7a47569c88b406c476: Status 404 returned error can't find the container with id 4744d0fabfdb79c88676a75e6b73c1a7378fc8d13aab8e7a47569c88b406c476
Jun 03 16:00:47.564889 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.564586    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-tlf69" podUID="2c454b31-62df-4148-9d4f-c72d70f908e7" containerName="authorino" containerID="cri-o://915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb" gracePeriod=30
Jun 03 16:00:47.565128 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.564999    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-tlf69" event={"ID":"2c454b31-62df-4148-9d4f-c72d70f908e7","Type":"ContainerStarted","Data":"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"}
Jun 03 16:00:47.566915 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.566880    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557768694f-qqbq2" event={"ID":"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a","Type":"ContainerStarted","Data":"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"}
Jun 03 16:00:47.567097 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.566923    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557768694f-qqbq2" event={"ID":"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a","Type":"ContainerStarted","Data":"4744d0fabfdb79c88676a75e6b73c1a7378fc8d13aab8e7a47569c88b406c476"}
Jun 03 16:00:47.568381 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.568351    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6d78449c-txg9g" event={"ID":"4e4a4f5d-f987-4b52-a32c-9e9837139423","Type":"ContainerStarted","Data":"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"}
Jun 03 16:00:47.569295 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.568548    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5b6d78449c-txg9g" podUID="4e4a4f5d-f987-4b52-a32c-9e9837139423" containerName="authorino" containerID="cri-o://e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281" gracePeriod=30
Jun 03 16:00:47.587401 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.587337    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-tlf69" podStartSLOduration=2.209794497 podStartE2EDuration="2.587322248s" podCreationTimestamp="2026-06-03 16:00:45 +0000 UTC" firstStartedPulling="2026-06-03 16:00:46.180300631 +0000 UTC m=+707.898745741" lastFinishedPulling="2026-06-03 16:00:46.5578284 +0000 UTC m=+708.276273492" observedRunningTime="2026-06-03 16:00:47.585188417 +0000 UTC m=+709.303633529" watchObservedRunningTime="2026-06-03 16:00:47.587322248 +0000 UTC m=+709.305767360"
Jun 03 16:00:47.600837 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.600770    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5b6d78449c-txg9g" podStartSLOduration=1.2501389569999999 podStartE2EDuration="1.600751307s" podCreationTimestamp="2026-06-03 16:00:46 +0000 UTC" firstStartedPulling="2026-06-03 16:00:46.526296795 +0000 UTC m=+708.244741886" lastFinishedPulling="2026-06-03 16:00:46.876909128 +0000 UTC m=+708.595354236" observedRunningTime="2026-06-03 16:00:47.600642302 +0000 UTC m=+709.319087414" watchObservedRunningTime="2026-06-03 16:00:47.600751307 +0000 UTC m=+709.319196413"
Jun 03 16:00:47.626460 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.626390    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-557768694f-qqbq2" podStartSLOduration=1.361390981 podStartE2EDuration="1.626369282s" podCreationTimestamp="2026-06-03 16:00:46 +0000 UTC" firstStartedPulling="2026-06-03 16:00:47.207888753 +0000 UTC m=+708.926333855" lastFinishedPulling="2026-06-03 16:00:47.472867065 +0000 UTC m=+709.191312156" observedRunningTime="2026-06-03 16:00:47.623415024 +0000 UTC m=+709.341860139" watchObservedRunningTime="2026-06-03 16:00:47.626369282 +0000 UTC m=+709.344814397"
Jun 03 16:00:47.654410 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.654371    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 16:00:47.654615 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.654593    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-rrvd6" podUID="e7285ae4-18d5-4c9a-accb-c231edce2886" containerName="authorino" containerID="cri-o://59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb" gracePeriod=30
Jun 03 16:00:47.947703 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.947675    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:47.965734 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.965709    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:47.980933 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:47.980903    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 16:00:48.107363 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.107326    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzjnp\" (UniqueName: \"kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp\") pod \"4e4a4f5d-f987-4b52-a32c-9e9837139423\" (UID: \"4e4a4f5d-f987-4b52-a32c-9e9837139423\") "
Jun 03 16:00:48.107529 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.107372    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh9vj\" (UniqueName: \"kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj\") pod \"e7285ae4-18d5-4c9a-accb-c231edce2886\" (UID: \"e7285ae4-18d5-4c9a-accb-c231edce2886\") "
Jun 03 16:00:48.107529 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.107417    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c4kd\" (UniqueName: \"kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd\") pod \"2c454b31-62df-4148-9d4f-c72d70f908e7\" (UID: \"2c454b31-62df-4148-9d4f-c72d70f908e7\") "
Jun 03 16:00:48.109699 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.109661    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj" (OuterVolumeSpecName: "kube-api-access-lh9vj") pod "e7285ae4-18d5-4c9a-accb-c231edce2886" (UID: "e7285ae4-18d5-4c9a-accb-c231edce2886"). InnerVolumeSpecName "kube-api-access-lh9vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:00:48.109699 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.109673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp" (OuterVolumeSpecName: "kube-api-access-fzjnp") pod "4e4a4f5d-f987-4b52-a32c-9e9837139423" (UID: "4e4a4f5d-f987-4b52-a32c-9e9837139423"). InnerVolumeSpecName "kube-api-access-fzjnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:00:48.109884 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.109684    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd" (OuterVolumeSpecName: "kube-api-access-7c4kd") pod "2c454b31-62df-4148-9d4f-c72d70f908e7" (UID: "2c454b31-62df-4148-9d4f-c72d70f908e7"). InnerVolumeSpecName "kube-api-access-7c4kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:00:48.208905 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.208864    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzjnp\" (UniqueName: \"kubernetes.io/projected/4e4a4f5d-f987-4b52-a32c-9e9837139423-kube-api-access-fzjnp\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 16:00:48.208905 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.208896    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh9vj\" (UniqueName: \"kubernetes.io/projected/e7285ae4-18d5-4c9a-accb-c231edce2886-kube-api-access-lh9vj\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 16:00:48.208905 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.208907    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c4kd\" (UniqueName: \"kubernetes.io/projected/2c454b31-62df-4148-9d4f-c72d70f908e7-kube-api-access-7c4kd\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 16:00:48.574412 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.574373    2562 generic.go:358] "Generic (PLEG): container finished" podID="e7285ae4-18d5-4c9a-accb-c231edce2886" containerID="59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb" exitCode=0
Jun 03 16:00:48.574610 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.574432    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rrvd6"
Jun 03 16:00:48.574610 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.574459    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rrvd6" event={"ID":"e7285ae4-18d5-4c9a-accb-c231edce2886","Type":"ContainerDied","Data":"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"}
Jun 03 16:00:48.574610 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.574494    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rrvd6" event={"ID":"e7285ae4-18d5-4c9a-accb-c231edce2886","Type":"ContainerDied","Data":"f5e4a940d124bdf72653524d58a484fc40224fbbe40c947793f0d8461b8d9368"}
Jun 03 16:00:48.574610 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.574514    2562 scope.go:117] "RemoveContainer" containerID="59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"
Jun 03 16:00:48.575861 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.575751    2562 generic.go:358] "Generic (PLEG): container finished" podID="4e4a4f5d-f987-4b52-a32c-9e9837139423" containerID="e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281" exitCode=0
Jun 03 16:00:48.575861 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.575812    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6d78449c-txg9g"
Jun 03 16:00:48.575861 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.575824    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6d78449c-txg9g" event={"ID":"4e4a4f5d-f987-4b52-a32c-9e9837139423","Type":"ContainerDied","Data":"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"}
Jun 03 16:00:48.575861 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.575848    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6d78449c-txg9g" event={"ID":"4e4a4f5d-f987-4b52-a32c-9e9837139423","Type":"ContainerDied","Data":"ee110c484c94523cca6f48ea7f031d4c3b1ebb0a0c6e8130723fd5e00622fc4b"}
Jun 03 16:00:48.580302 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.580269    2562 generic.go:358] "Generic (PLEG): container finished" podID="2c454b31-62df-4148-9d4f-c72d70f908e7" containerID="915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb" exitCode=0
Jun 03 16:00:48.580463 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.580327    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-tlf69"
Jun 03 16:00:48.580463 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.580345    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-tlf69" event={"ID":"2c454b31-62df-4148-9d4f-c72d70f908e7","Type":"ContainerDied","Data":"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"}
Jun 03 16:00:48.580463 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.580378    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-tlf69" event={"ID":"2c454b31-62df-4148-9d4f-c72d70f908e7","Type":"ContainerDied","Data":"ff7907ca4ea4bf8ff48278ef9d7b6f89a2f47ef750c8ee0ed9900b247922e4f0"}
Jun 03 16:00:48.586210 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.586184    2562 scope.go:117] "RemoveContainer" containerID="59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"
Jun 03 16:00:48.586678 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:00:48.586652    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb\": container with ID starting with 59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb not found: ID does not exist" containerID="59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"
Jun 03 16:00:48.586859 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.586692    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb"} err="failed to get container status \"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb\": rpc error: code = NotFound desc = could not find container \"59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb\": container with ID starting with 59feb0992f803ca520bf1d397bc59bd8f5c65ed443789f8361fbffa087d1e3cb not found: ID does not exist"
Jun 03 16:00:48.586859 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.586720    2562 scope.go:117] "RemoveContainer" containerID="e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"
Jun 03 16:00:48.595920 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.595898    2562 scope.go:117] "RemoveContainer" containerID="e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"
Jun 03 16:00:48.596228 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:00:48.596206    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281\": container with ID starting with e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281 not found: ID does not exist" containerID="e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"
Jun 03 16:00:48.596293 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.596237    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281"} err="failed to get container status \"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281\": rpc error: code = NotFound desc = could not find container \"e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281\": container with ID starting with e51c5266757ba50aff25dbd6c45fc0a82b3db6303deff84dca4838190f0b5281 not found: ID does not exist"
Jun 03 16:00:48.596293 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.596259    2562 scope.go:117] "RemoveContainer" containerID="915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"
Jun 03 16:00:48.602117 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.602086    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 16:00:48.605299 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.605277    2562 scope.go:117] "RemoveContainer" containerID="915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"
Jun 03 16:00:48.605656 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:00:48.605632    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb\": container with ID starting with 915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb not found: ID does not exist" containerID="915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"
Jun 03 16:00:48.605730 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.605668    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb"} err="failed to get container status \"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb\": rpc error: code = NotFound desc = could not find container \"915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb\": container with ID starting with 915d118a0449329481a9a06d69919fe00116be87d5bd5e4ca48960df388c83eb not found: ID does not exist"
Jun 03 16:00:48.606333 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.606313    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-rrvd6"]
Jun 03 16:00:48.624027 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.622993    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:48.626186 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.626154    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-tlf69"]
Jun 03 16:00:48.634212 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.634178    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:48.641511 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.641481    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b6d78449c-txg9g"]
Jun 03 16:00:48.825861 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.825768    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c454b31-62df-4148-9d4f-c72d70f908e7" path="/var/lib/kubelet/pods/2c454b31-62df-4148-9d4f-c72d70f908e7/volumes"
Jun 03 16:00:48.826157 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.826143    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4a4f5d-f987-4b52-a32c-9e9837139423" path="/var/lib/kubelet/pods/4e4a4f5d-f987-4b52-a32c-9e9837139423/volumes"
Jun 03 16:00:48.826433 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:48.826421    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7285ae4-18d5-4c9a-accb-c231edce2886" path="/var/lib/kubelet/pods/e7285ae4-18d5-4c9a-accb-c231edce2886/volumes"
Jun 03 16:00:51.283071 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283031    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cf4dc7ccb-pzvqx"]
Jun 03 16:00:51.283454 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283440    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c454b31-62df-4148-9d4f-c72d70f908e7" containerName="authorino"
Jun 03 16:00:51.283515 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283456    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c454b31-62df-4148-9d4f-c72d70f908e7" containerName="authorino"
Jun 03 16:00:51.283515 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283486    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e4a4f5d-f987-4b52-a32c-9e9837139423" containerName="authorino"
Jun 03 16:00:51.283515 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283492    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e4a4f5d-f987-4b52-a32c-9e9837139423" containerName="authorino"
Jun 03 16:00:51.283515 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283498    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7285ae4-18d5-4c9a-accb-c231edce2886" containerName="authorino"
Jun 03 16:00:51.283515 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283505    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7285ae4-18d5-4c9a-accb-c231edce2886" containerName="authorino"
Jun 03 16:00:51.283688 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283566    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c454b31-62df-4148-9d4f-c72d70f908e7" containerName="authorino"
Jun 03 16:00:51.283688 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283573    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7285ae4-18d5-4c9a-accb-c231edce2886" containerName="authorino"
Jun 03 16:00:51.283688 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.283580    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e4a4f5d-f987-4b52-a32c-9e9837139423" containerName="authorino"
Jun 03 16:00:51.286676 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.286653    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:51.288926 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.288901    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 16:00:51.289065 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.288993    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfgxn\""
Jun 03 16:00:51.296305 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.296274    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cf4dc7ccb-pzvqx"]
Jun 03 16:00:51.439590 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.439543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxkbf\" (UniqueName: \"kubernetes.io/projected/97be9974-13fb-4c50-bf42-bb6badea023a-kube-api-access-pxkbf\") pod \"maas-controller-cf4dc7ccb-pzvqx\" (UID: \"97be9974-13fb-4c50-bf42-bb6badea023a\") " pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:51.541268 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.541153    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxkbf\" (UniqueName: \"kubernetes.io/projected/97be9974-13fb-4c50-bf42-bb6badea023a-kube-api-access-pxkbf\") pod \"maas-controller-cf4dc7ccb-pzvqx\" (UID: \"97be9974-13fb-4c50-bf42-bb6badea023a\") " pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:51.552150 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.552115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxkbf\" (UniqueName: \"kubernetes.io/projected/97be9974-13fb-4c50-bf42-bb6badea023a-kube-api-access-pxkbf\") pod \"maas-controller-cf4dc7ccb-pzvqx\" (UID: \"97be9974-13fb-4c50-bf42-bb6badea023a\") " pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:51.598683 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.598641    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:51.748452 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:51.748390    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cf4dc7ccb-pzvqx"]
Jun 03 16:00:51.751548 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:00:51.751517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97be9974_13fb_4c50_bf42_bb6badea023a.slice/crio-779c2aa98606539fe53b5365309d85ed2ec03fb25f62f82250a41f28ff527057 WatchSource:0}: Error finding container 779c2aa98606539fe53b5365309d85ed2ec03fb25f62f82250a41f28ff527057: Status 404 returned error can't find the container with id 779c2aa98606539fe53b5365309d85ed2ec03fb25f62f82250a41f28ff527057
Jun 03 16:00:52.601759 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:52.601716    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx" event={"ID":"97be9974-13fb-4c50-bf42-bb6badea023a","Type":"ContainerStarted","Data":"779c2aa98606539fe53b5365309d85ed2ec03fb25f62f82250a41f28ff527057"}
Jun 03 16:00:54.611798 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:54.611747    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx" event={"ID":"97be9974-13fb-4c50-bf42-bb6badea023a","Type":"ContainerStarted","Data":"de9655120afe21f0804a770253efc0165b76a7d61ae682af58e27aa26239797d"}
Jun 03 16:00:54.611798 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:54.611805    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:00:54.634564 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:00:54.634507    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx" podStartSLOduration=1.264975337 podStartE2EDuration="3.634492187s" podCreationTimestamp="2026-06-03 16:00:51 +0000 UTC" firstStartedPulling="2026-06-03 16:00:51.753278994 +0000 UTC m=+713.471724086" lastFinishedPulling="2026-06-03 16:00:54.122795845 +0000 UTC m=+715.841240936" observedRunningTime="2026-06-03 16:00:54.634255788 +0000 UTC m=+716.352700901" watchObservedRunningTime="2026-06-03 16:00:54.634492187 +0000 UTC m=+716.352937279"
Jun 03 16:01:05.624500 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:05.624465    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cf4dc7ccb-pzvqx"
Jun 03 16:01:27.281568 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.281525    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-757df69f6f-zcsnk"]
Jun 03 16:01:27.298180 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.298123    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-757df69f6f-zcsnk"]
Jun 03 16:01:27.298366 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.298290    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.300628 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.300600    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 16:01:27.365897 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.365862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.366097 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.365912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdq7l\" (UniqueName: \"kubernetes.io/projected/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-kube-api-access-wdq7l\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.467094 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.467044    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.467291 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.467116    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdq7l\" (UniqueName: \"kubernetes.io/projected/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-kube-api-access-wdq7l\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.467291 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:01:27.467191    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jun 03 16:01:27.467291 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:01:27.467262    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls podName:5333a0f9-eaea-4863-9034-1b2f4a4a6edd nodeName:}" failed. No retries permitted until 2026-06-03 16:01:27.967246687 +0000 UTC m=+749.685691778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls") pod "maas-api-757df69f6f-zcsnk" (UID: "5333a0f9-eaea-4863-9034-1b2f4a4a6edd") : secret "maas-api-serving-cert" not found
Jun 03 16:01:27.476906 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.476872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdq7l\" (UniqueName: \"kubernetes.io/projected/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-kube-api-access-wdq7l\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.972171 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.972128    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:27.974879 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:27.974850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5333a0f9-eaea-4863-9034-1b2f4a4a6edd-maas-api-tls\") pod \"maas-api-757df69f6f-zcsnk\" (UID: \"5333a0f9-eaea-4863-9034-1b2f4a4a6edd\") " pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:28.211461 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:28.211419    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:28.361409 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:28.361246    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-757df69f6f-zcsnk"]
Jun 03 16:01:28.364234 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:01:28.364196    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5333a0f9_eaea_4863_9034_1b2f4a4a6edd.slice/crio-af990d5ad8833c6e8b52cbbdb2387650dee58ce008aa3b2a3594489e574afec7 WatchSource:0}: Error finding container af990d5ad8833c6e8b52cbbdb2387650dee58ce008aa3b2a3594489e574afec7: Status 404 returned error can't find the container with id af990d5ad8833c6e8b52cbbdb2387650dee58ce008aa3b2a3594489e574afec7
Jun 03 16:01:28.365391 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:28.365370    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 16:01:28.744002 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:28.743927    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-757df69f6f-zcsnk" event={"ID":"5333a0f9-eaea-4863-9034-1b2f4a4a6edd","Type":"ContainerStarted","Data":"af990d5ad8833c6e8b52cbbdb2387650dee58ce008aa3b2a3594489e574afec7"}
Jun 03 16:01:30.761914 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:30.761873    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-757df69f6f-zcsnk" event={"ID":"5333a0f9-eaea-4863-9034-1b2f4a4a6edd","Type":"ContainerStarted","Data":"0805a775367cd37f303492b24add8774e75c19c8472204ab7c373ebba0cd056e"}
Jun 03 16:01:30.762325 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:30.762014    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:01:30.805407 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:30.805351    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-757df69f6f-zcsnk" podStartSLOduration=2.05083383 podStartE2EDuration="3.805336745s" podCreationTimestamp="2026-06-03 16:01:27 +0000 UTC" firstStartedPulling="2026-06-03 16:01:28.365542666 +0000 UTC m=+750.083987771" lastFinishedPulling="2026-06-03 16:01:30.120045578 +0000 UTC m=+751.838490686" observedRunningTime="2026-06-03 16:01:30.803912234 +0000 UTC m=+752.522357347" watchObservedRunningTime="2026-06-03 16:01:30.805336745 +0000 UTC m=+752.523781860"
Jun 03 16:01:36.771420 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:01:36.771390    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-757df69f6f-zcsnk"
Jun 03 16:02:16.308089 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.308051    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcd47d6dc-jq8m6"]
Jun 03 16:02:16.311567 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.311544    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.313854 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.313826    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jun 03 16:02:16.318040 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.318011    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcd47d6dc-jq8m6"]
Jun 03 16:02:16.417334 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.417296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-oidc-ca\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.417550 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.417358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss4mz\" (UniqueName: \"kubernetes.io/projected/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-kube-api-access-ss4mz\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.417550 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.417463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-tls-cert\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.518660 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.518613    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-oidc-ca\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.518870 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.518710    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss4mz\" (UniqueName: \"kubernetes.io/projected/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-kube-api-access-ss4mz\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.518870 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.518768    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-tls-cert\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.519420 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.519395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-oidc-ca\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.521497 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.521472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-tls-cert\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.529903 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.529875    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss4mz\" (UniqueName: \"kubernetes.io/projected/0dc9b9ee-7b2a-4f42-872a-3262160e0b05-kube-api-access-ss4mz\") pod \"authorino-7bcd47d6dc-jq8m6\" (UID: \"0dc9b9ee-7b2a-4f42-872a-3262160e0b05\") " pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.622447 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.622403    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6"
Jun 03 16:02:16.774857 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.774828    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcd47d6dc-jq8m6"]
Jun 03 16:02:16.777745 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:02:16.777700    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dc9b9ee_7b2a_4f42_872a_3262160e0b05.slice/crio-c75d7a2127be484dd3d553f12f59a68028a1486c89d0f841ecca7a8ae1387854 WatchSource:0}: Error finding container c75d7a2127be484dd3d553f12f59a68028a1486c89d0f841ecca7a8ae1387854: Status 404 returned error can't find the container with id c75d7a2127be484dd3d553f12f59a68028a1486c89d0f841ecca7a8ae1387854
Jun 03 16:02:16.946099 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:16.946011    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6" event={"ID":"0dc9b9ee-7b2a-4f42-872a-3262160e0b05","Type":"ContainerStarted","Data":"c75d7a2127be484dd3d553f12f59a68028a1486c89d0f841ecca7a8ae1387854"}
Jun 03 16:02:17.951601 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:17.951561    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6" event={"ID":"0dc9b9ee-7b2a-4f42-872a-3262160e0b05","Type":"ContainerStarted","Data":"8ed21ecb734cf7a64b05ee39e2b4b3c67abee39aa20fa2d7d6bf5edaf049a623"}
Jun 03 16:02:17.968427 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:17.968205    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcd47d6dc-jq8m6" podStartSLOduration=1.629576724 podStartE2EDuration="1.968186188s" podCreationTimestamp="2026-06-03 16:02:16 +0000 UTC" firstStartedPulling="2026-06-03 16:02:16.779102243 +0000 UTC m=+798.497547334" lastFinishedPulling="2026-06-03 16:02:17.117711707 +0000 UTC m=+798.836156798" observedRunningTime="2026-06-03 16:02:17.967540952 +0000 UTC m=+799.685986064" watchObservedRunningTime="2026-06-03 16:02:17.968186188 +0000 UTC m=+799.686631303"
Jun 03 16:02:17.997654 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:17.997613    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:02:17.998007 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:17.997910    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-557768694f-qqbq2" podUID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" containerName="authorino" containerID="cri-o://5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5" gracePeriod=30
Jun 03 16:02:18.274020 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.273966    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:02:18.334210 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.334173    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9w7m\" (UniqueName: \"kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m\") pod \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") "
Jun 03 16:02:18.334402 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.334246    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert\") pod \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\" (UID: \"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a\") "
Jun 03 16:02:18.336541 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.336509    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m" (OuterVolumeSpecName: "kube-api-access-w9w7m") pod "954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" (UID: "954c8ac6-b4f9-4a24-9c57-4c27e7e1413a"). InnerVolumeSpecName "kube-api-access-w9w7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 16:02:18.348427 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.348391    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" (UID: "954c8ac6-b4f9-4a24-9c57-4c27e7e1413a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 16:02:18.435486 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.435440    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9w7m\" (UniqueName: \"kubernetes.io/projected/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-kube-api-access-w9w7m\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 16:02:18.435486 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.435478    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a-tls-cert\") on node \"ip-10-0-135-102.ec2.internal\" DevicePath \"\""
Jun 03 16:02:18.955938 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.955893    2562 generic.go:358] "Generic (PLEG): container finished" podID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" containerID="5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5" exitCode=0
Jun 03 16:02:18.956443 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.956019    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557768694f-qqbq2"
Jun 03 16:02:18.956443 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.956026    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557768694f-qqbq2" event={"ID":"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a","Type":"ContainerDied","Data":"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"}
Jun 03 16:02:18.956443 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.956087    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557768694f-qqbq2" event={"ID":"954c8ac6-b4f9-4a24-9c57-4c27e7e1413a","Type":"ContainerDied","Data":"4744d0fabfdb79c88676a75e6b73c1a7378fc8d13aab8e7a47569c88b406c476"}
Jun 03 16:02:18.956443 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.956111    2562 scope.go:117] "RemoveContainer" containerID="5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"
Jun 03 16:02:18.965589 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.965561    2562 scope.go:117] "RemoveContainer" containerID="5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"
Jun 03 16:02:18.965951 ip-10-0-135-102 kubenswrapper[2562]: E0603 16:02:18.965924    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5\": container with ID starting with 5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5 not found: ID does not exist" containerID="5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"
Jun 03 16:02:18.966160 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.965959    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5"} err="failed to get container status \"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5\": rpc error: code = NotFound desc = could not find container \"5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5\": container with ID starting with 5b2013efec8c9ab783412891246e2e5bf82a86dda721594feb851ef3fc2886e5 not found: ID does not exist"
Jun 03 16:02:18.986140 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.986102    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:02:18.994250 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:18.994209    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557768694f-qqbq2"]
Jun 03 16:02:20.825490 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:20.825447    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" path="/var/lib/kubelet/pods/954c8ac6-b4f9-4a24-9c57-4c27e7e1413a/volumes"
Jun 03 16:02:58.000784 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.000743    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"]
Jun 03 16:02:58.001356 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.001284    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" containerName="authorino"
Jun 03 16:02:58.001356 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.001306    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" containerName="authorino"
Jun 03 16:02:58.001491 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.001436    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="954c8ac6-b4f9-4a24-9c57-4c27e7e1413a" containerName="authorino"
Jun 03 16:02:58.005001 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.004966    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.007363 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.007341    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 16:02:58.008239 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.008147    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 03 16:02:58.008239 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.008163    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z6r2v\""
Jun 03 16:02:58.008239 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.008165    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 16:02:58.020864 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.020835    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"]
Jun 03 16:02:58.090583 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.090780 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.090780 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.090780 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.090780 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccgq\" (UniqueName: \"kubernetes.io/projected/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kube-api-access-9ccgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.090780 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.090722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192212 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192164    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccgq\" (UniqueName: \"kubernetes.io/projected/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kube-api-access-9ccgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192212 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192219    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192483 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192307    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192483 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192348    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192483 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192377    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192483 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192415    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192796 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192860 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.192903 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.192855    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.194693 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.194671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.194956 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.194937    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.202675 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.202646    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccgq\" (UniqueName: \"kubernetes.io/projected/da3f4d44-97b9-42d1-8611-eb6cf27d33a9-kube-api-access-9ccgq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l\" (UID: \"da3f4d44-97b9-42d1-8611-eb6cf27d33a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.317608 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.317505    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:02:58.471644 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:58.471614    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"]
Jun 03 16:02:58.473767 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:02:58.473732    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3f4d44_97b9_42d1_8611_eb6cf27d33a9.slice/crio-d1a9cbc2c620c2315ec63b6e28bac342feb84cc904d4fca8556053d7ebcc55a5 WatchSource:0}: Error finding container d1a9cbc2c620c2315ec63b6e28bac342feb84cc904d4fca8556053d7ebcc55a5: Status 404 returned error can't find the container with id d1a9cbc2c620c2315ec63b6e28bac342feb84cc904d4fca8556053d7ebcc55a5
Jun 03 16:02:59.118343 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:02:59.118300    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l" event={"ID":"da3f4d44-97b9-42d1-8611-eb6cf27d33a9","Type":"ContainerStarted","Data":"d1a9cbc2c620c2315ec63b6e28bac342feb84cc904d4fca8556053d7ebcc55a5"}
Jun 03 16:03:02.133038 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:02.132964    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l" event={"ID":"da3f4d44-97b9-42d1-8611-eb6cf27d33a9","Type":"ContainerStarted","Data":"8bcf5c5aae89d710453fbcda9f2435b21e6cd3d1621c8c3ac20dd74b9ec2e8ce"}
Jun 03 16:03:11.169602 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:11.169564    2562 generic.go:358] "Generic (PLEG): container finished" podID="da3f4d44-97b9-42d1-8611-eb6cf27d33a9" containerID="8bcf5c5aae89d710453fbcda9f2435b21e6cd3d1621c8c3ac20dd74b9ec2e8ce" exitCode=0
Jun 03 16:03:11.170005 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:11.169639    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l" event={"ID":"da3f4d44-97b9-42d1-8611-eb6cf27d33a9","Type":"ContainerDied","Data":"8bcf5c5aae89d710453fbcda9f2435b21e6cd3d1621c8c3ac20dd74b9ec2e8ce"}
Jun 03 16:03:18.197763 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:18.197716    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l" event={"ID":"da3f4d44-97b9-42d1-8611-eb6cf27d33a9","Type":"ContainerStarted","Data":"f6f0284f7790eee208229ac3cf5e44059295d6ca9bc9c8aaa6f8d1963f617107"}
Jun 03 16:03:18.218901 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:18.218842    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l" podStartSLOduration=1.927746508 podStartE2EDuration="21.218829175s" podCreationTimestamp="2026-06-03 16:02:57 +0000 UTC" firstStartedPulling="2026-06-03 16:02:58.475682974 +0000 UTC m=+840.194128065" lastFinishedPulling="2026-06-03 16:03:17.766765626 +0000 UTC m=+859.485210732" observedRunningTime="2026-06-03 16:03:18.218496247 +0000 UTC m=+859.936941359" watchObservedRunningTime="2026-06-03 16:03:18.218829175 +0000 UTC m=+859.937274362"
Jun 03 16:03:18.318681 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:18.318642    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:03:18.318681 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:18.318693    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:03:18.331246 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:18.331215    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:03:19.212854 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:19.212814    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l"
Jun 03 16:03:58.796800 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:58.796767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 16:03:58.798606 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:58.798581    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 16:03:58.804036 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:58.804011    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 16:03:58.805634 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:03:58.805614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 16:08:58.827045 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:08:58.827014    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 16:08:58.829911 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:08:58.829886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 16:08:58.834766 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:08:58.834738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 16:08:58.837069 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:08:58.837046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jlgn5_88976586-c663-4f59-853c-7003507980b4/ovn-acl-logging/0.log"
Jun 03 16:09:27.019091 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:27.019057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bcd47d6dc-jq8m6_0dc9b9ee-7b2a-4f42-872a-3262160e0b05/authorino/0.log"
Jun 03 16:09:31.712307 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:31.712271    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78c4457769-fts9p_cfef17ac-b0ef-41a7-97f1-28e25c1aafa1/nginx/0.log"
Jun 03 16:09:31.971612 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:31.971524    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9bvhs_61bb0b00-e7fd-4e69-9446-c3734e85ce9f/manager/0.log"
Jun 03 16:09:32.096286 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.096253    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-d22t5_d550b819-48ea-4253-b6d5-2437e21b30fd/manager/0.log"
Jun 03 16:09:32.224359 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.224276    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-757df69f6f-zcsnk_5333a0f9-eaea-4863-9034-1b2f4a4a6edd/maas-api/0.log"
Jun 03 16:09:32.356766 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.356733    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cf4dc7ccb-pzvqx_97be9974-13fb-4c50-bf42-bb6badea023a/manager/0.log"
Jun 03 16:09:32.473927 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.473890    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-qhg79_67e5e796-e40b-46f9-b6a5-879bd1a8bf4a/server/0.log"
Jun 03 16:09:32.590357 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.590256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fccbz_6c32b770-6038-4c20-9a3e-fd9d581ac930/manager/0.log"
Jun 03 16:09:32.712052 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.712023    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-2g4kz_94e5315d-7b65-460b-959f-e1e9b2bd7c2a/copy-manifests/0.log"
Jun 03 16:09:32.721341 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:32.721303    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-2g4kz_94e5315d-7b65-460b-959f-e1e9b2bd7c2a/manager/0.log"
Jun 03 16:09:33.161911 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:33.161877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-n7clm_3e6ddb36-d74c-429e-b8a3-3b45808ce531/postgres/0.log"
Jun 03 16:09:34.592036 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:34.591968    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bcd47d6dc-jq8m6_0dc9b9ee-7b2a-4f42-872a-3262160e0b05/authorino/0.log"
Jun 03 16:09:34.720029 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:34.720001    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4mnnl_e0824d8c-073d-4600-b5e3-bd02f8729caa/manager/0.log"
Jun 03 16:09:34.857063 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:34.857040    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-www8w_5ccade3f-aa00-4327-9459-b17d8415733b/manager/0.log"
Jun 03 16:09:35.087831 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:35.087796    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-46hgj_7a5d1e67-ed10-4f3c-b862-a725dce1e0f5/registry-server/0.log"
Jun 03 16:09:35.824519 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:35.824483    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bs97br_aca10c3c-d14b-4c03-937b-5337baea4434/istio-proxy/0.log"
Jun 03 16:09:36.089038 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:36.088952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b7b64cc-7mrs9_91a881cd-c226-4b62-953f-3d3784d31147/kube-auth-proxy/0.log"
Jun 03 16:09:36.337372 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:36.337345    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-245cv_a93206ff-08b7-4215-a923-81ca69e93ae8/istio-proxy/0.log"
Jun 03 16:09:36.575061 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:36.575033    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595576bf8c-cp6dz_10798e32-9ffa-44ed-a408-c2ff6e562dd0/router/0.log"
Jun 03 16:09:37.342010 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:37.341945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l_da3f4d44-97b9-42d1-8611-eb6cf27d33a9/storage-initializer/0.log"
Jun 03 16:09:37.355858 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:37.355828    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9zw92l_da3f4d44-97b9-42d1-8611-eb6cf27d33a9/main/0.log"
Jun 03 16:09:45.660324 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:45.660232    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-79fhh_d159f76a-351c-4709-a7b5-657fd5529ac0/global-pull-secret-syncer/0.log"
Jun 03 16:09:45.982006 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:45.981886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gsw87_141272c3-b793-4f3d-9ca7-ac87ae82bc00/konnectivity-agent/0.log"
Jun 03 16:09:46.223482 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:46.223451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-102.ec2.internal_141341a8c185dbd90d002b2037e0f25d/haproxy/0.log"
Jun 03 16:09:50.357122 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:50.357086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bcd47d6dc-jq8m6_0dc9b9ee-7b2a-4f42-872a-3262160e0b05/authorino/0.log"
Jun 03 16:09:50.417137 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:50.417106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4mnnl_e0824d8c-073d-4600-b5e3-bd02f8729caa/manager/0.log"
Jun 03 16:09:50.478380 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:50.478342    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-www8w_5ccade3f-aa00-4327-9459-b17d8415733b/manager/0.log"
Jun 03 16:09:50.569350 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:50.569318    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-46hgj_7a5d1e67-ed10-4f3c-b862-a725dce1e0f5/registry-server/0.log"
Jun 03 16:09:52.717885 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:52.717847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-f5q85_1dbd68ca-2505-4ac4-a44e-74c13b9a356f/cluster-monitoring-operator/0.log"
Jun 03 16:09:53.185037 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:53.185004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/node-exporter/0.log"
Jun 03 16:09:53.235137 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:53.235109    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/kube-rbac-proxy/0.log"
Jun 03 16:09:53.276715 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:53.276688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n662_a90ecdb8-a5d3-4d4c-a25e-2f2ba19e910d/init-textfile/0.log"
Jun 03 16:09:54.574492 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.574449    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"]
Jun 03 16:09:54.577348 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.577329    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.579989 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.579941    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"openshift-service-ca.crt\""
Jun 03 16:09:54.580127 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.579949    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"kube-root-ca.crt\""
Jun 03 16:09:54.580699 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.580679    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpskt\"/\"default-dockercfg-ff6qh\""
Jun 03 16:09:54.592564 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.592525    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"]
Jun 03 16:09:54.657494 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.657452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dlj8\" (UniqueName: \"kubernetes.io/projected/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-kube-api-access-7dlj8\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.657705 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.657514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-lib-modules\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.657705 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.657581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-podres\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.657705 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.657613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-proc\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.657867 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.657724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-sys\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758397 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758361    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-podres\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758579 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758414    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-proc\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758579 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758458    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-sys\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758579 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758489    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dlj8\" (UniqueName: \"kubernetes.io/projected/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-kube-api-access-7dlj8\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758579 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758515    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-lib-modules\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758736 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-sys\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758736 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-podres\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758736 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758584    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-proc\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.758736 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.758668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-lib-modules\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.770508 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.770480    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dlj8\" (UniqueName: \"kubernetes.io/projected/7e8bd446-4e16-44e2-ad9e-0fabf72b9dff-kube-api-access-7dlj8\") pod \"perf-node-gather-daemonset-64k7p\" (UID: \"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:54.887830 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:54.887792    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:55.049221 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.049187    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"]
Jun 03 16:09:55.051685 ip-10-0-135-102 kubenswrapper[2562]: W0603 16:09:55.051652    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e8bd446_4e16_44e2_ad9e_0fabf72b9dff.slice/crio-323dd8308e7e04055bcab611947a9a6fc3157cae8716a4aa98de931bae326217 WatchSource:0}: Error finding container 323dd8308e7e04055bcab611947a9a6fc3157cae8716a4aa98de931bae326217: Status 404 returned error can't find the container with id 323dd8308e7e04055bcab611947a9a6fc3157cae8716a4aa98de931bae326217
Jun 03 16:09:55.053356 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.053337    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 16:09:55.630682 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.630646    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-xqsq2_4e3dd312-b361-41d0-aca5-dbc75fd21d16/networking-console-plugin/0.log"
Jun 03 16:09:55.748690 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.748652    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p" event={"ID":"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff","Type":"ContainerStarted","Data":"aab6e06861d7c4c0854f3d7228b9d9ca0ab558ba6e49682e12aee4e3432ca9d0"}
Jun 03 16:09:55.748690 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.748692    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p" event={"ID":"7e8bd446-4e16-44e2-ad9e-0fabf72b9dff","Type":"ContainerStarted","Data":"323dd8308e7e04055bcab611947a9a6fc3157cae8716a4aa98de931bae326217"}
Jun 03 16:09:55.748917 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.748762    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:09:55.779923 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:55.779868    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p" podStartSLOduration=1.779850348 podStartE2EDuration="1.779850348s" podCreationTimestamp="2026-06-03 16:09:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:09:55.779279171 +0000 UTC m=+1257.497724285" watchObservedRunningTime="2026-06-03 16:09:55.779850348 +0000 UTC m=+1257.498295516"
Jun 03 16:09:56.303455 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:56.303424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/2.log"
Jun 03 16:09:56.307650 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:56.307623    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5lrcg_aba055c2-fc0c-4473-abdc-ee2f24efa1d7/console-operator/3.log"
Jun 03 16:09:57.724679 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:57.724645    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-svcln_05ca1d00-2cba-47bf-89f1-cb2a714c8b7f/volume-data-source-validator/0.log"
Jun 03 16:09:58.748763 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:58.748694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2r64w_a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8/dns/0.log"
Jun 03 16:09:58.791386 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:58.791350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2r64w_a549d3a0-7fdb-4612-9f5d-5879bcc1b3b8/kube-rbac-proxy/0.log"
Jun 03 16:09:59.095736 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:59.095707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5p74_311562ad-9379-4db5-9c0e-90fdef2313cf/dns-node-resolver/0.log"
Jun 03 16:09:59.765375 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:09:59.765334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g5f5h_a74849aa-ac32-4d0f-b356-0e2346d8afad/node-ca/0.log"
Jun 03 16:10:01.127170 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:01.127135    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bs97br_aca10c3c-d14b-4c03-937b-5337baea4434/istio-proxy/0.log"
Jun 03 16:10:01.245480 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:01.245448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b7b64cc-7mrs9_91a881cd-c226-4b62-953f-3d3784d31147/kube-auth-proxy/0.log"
Jun 03 16:10:01.332405 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:01.332372    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-245cv_a93206ff-08b7-4215-a923-81ca69e93ae8/istio-proxy/0.log"
Jun 03 16:10:01.412407 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:01.412328    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-595576bf8c-cp6dz_10798e32-9ffa-44ed-a408-c2ff6e562dd0/router/0.log"
Jun 03 16:10:01.763308 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:01.763224    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-64k7p"
Jun 03 16:10:02.059831 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:02.059704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4zmt8_621e2760-8775-489e-afb5-d3fcbe7f74cd/serve-healthcheck-canary/0.log"
Jun 03 16:10:02.762833 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:02.762799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dtz65_32a6673a-b8ef-4140-a086-ede4fb74aa17/insights-operator/0.log"
Jun 03 16:10:02.763971 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:02.763948    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dtz65_32a6673a-b8ef-4140-a086-ede4fb74aa17/insights-operator/1.log"
Jun 03 16:10:03.029585 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:03.029494    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvj8j_fc1724a7-de7b-40e9-a5a6-20b8c574258c/kube-rbac-proxy/0.log"
Jun 03 16:10:03.081485 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:03.081458    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvj8j_fc1724a7-de7b-40e9-a5a6-20b8c574258c/exporter/0.log"
Jun 03 16:10:03.120639 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:03.120604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvj8j_fc1724a7-de7b-40e9-a5a6-20b8c574258c/extractor/0.log"
Jun 03 16:10:05.604690 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.604663    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78c4457769-fts9p_cfef17ac-b0ef-41a7-97f1-28e25c1aafa1/nginx/0.log"
Jun 03 16:10:05.692535 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.692503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9bvhs_61bb0b00-e7fd-4e69-9446-c3734e85ce9f/manager/0.log"
Jun 03 16:10:05.744080 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.744044    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-d22t5_d550b819-48ea-4253-b6d5-2437e21b30fd/manager/0.log"
Jun 03 16:10:05.783021 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.782960    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-757df69f6f-zcsnk_5333a0f9-eaea-4863-9034-1b2f4a4a6edd/maas-api/0.log"
Jun 03 16:10:05.824868 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.824837    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cf4dc7ccb-pzvqx_97be9974-13fb-4c50-bf42-bb6badea023a/manager/0.log"
Jun 03 16:10:05.859636 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.859541    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-qhg79_67e5e796-e40b-46f9-b6a5-879bd1a8bf4a/server/0.log"
Jun 03 16:10:05.921178 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.921143    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fccbz_6c32b770-6038-4c20-9a3e-fd9d581ac930/manager/0.log"
Jun 03 16:10:05.951530 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.951495    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-2g4kz_94e5315d-7b65-460b-959f-e1e9b2bd7c2a/manager/0.log"
Jun 03 16:10:05.984209 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:05.984182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-2g4kz_94e5315d-7b65-460b-959f-e1e9b2bd7c2a/copy-manifests/0.log"
Jun 03 16:10:06.201066 ip-10-0-135-102 kubenswrapper[2562]: I0603 16:10:06.200963    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-n7clm_3e6ddb36-d74c-429e-b8a3-3b45808ce531/postgres/0.log"