Jun 03 19:29:41.484291 ip-10-0-140-28 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:29:41.970523 ip-10-0-140-28 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:41.970523 ip-10-0-140-28 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:29:41.970523 ip-10-0-140-28 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:41.970523 ip-10-0-140-28 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:29:41.970523 ip-10-0-140-28 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:29:41.971639 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.971550 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:29:41.976968 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976940 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.976968 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976963 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.976968 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976968 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.976968 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976971 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.976968 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976976 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976981 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976985 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976988 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976991 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976994 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976996 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.976999 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977002 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977005 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977008 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977010 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977013 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977015 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977018 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977028 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977030 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977034 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977038 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.977204 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977042 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977045 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977047 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977050 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977053 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977056 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977058 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977061 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977064 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977066 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977069 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977071 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977074 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977076 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977080 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977083 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977086 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977089 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977091 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.977660 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977094 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977097 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977099 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977102 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977105 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977107 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977110 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977112 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977116 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977119 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977121 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977124 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977127 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977130 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977133 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977135 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977138 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977145 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977148 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977150 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.978179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977153 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977156 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977159 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977162 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977165 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977167 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977170 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977173 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977176 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977178 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977181 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977184 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977186 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977189 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977192 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977194 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977197 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977200 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977203 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977206 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.978673 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977209 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977213 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977215 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977218 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977221 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977225 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977229 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977232 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977235 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977238 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977240 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977243 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977246 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977248 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977251 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.977254 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978028 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978033 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978036 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.979173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978040 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978043 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978045 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978048 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978051 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978054 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978056 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978059 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978061 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978064 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978067 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978069 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978072 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978075 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978078 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978081 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978083 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978086 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978089 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978091 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.979663 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978094 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978096 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978099 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978102 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978105 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978108 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978111 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978113 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978116 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978118 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978121 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978123 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978127 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978130 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978132 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978135 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978137 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978140 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978143 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.980197 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978148 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978150 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978153 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978156 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978158 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978160 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978163 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978166 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978169 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978171 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978174 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978176 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978179 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978182 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978185 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978189 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978193 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978195 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978199 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.980685 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978201 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978204 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978208 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978211 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978215 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978217 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978220 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978223 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978225 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978228 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978230 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978234 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978236 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978239 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978241 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978244 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978246 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978249 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978251 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.981169 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978254 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978256 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978259 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978262 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978264 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978267 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978270 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978274 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978279 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978281 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978284 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978287 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978290 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978294 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978297 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978299 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978718 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978724 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978727 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.981652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978731 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978734 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978736 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978739 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978742 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978745 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978748 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978751 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978753 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978757 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978761 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978764 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978767 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978770 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978773 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978776 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978779 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978781 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978784 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.982132 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978787 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978790 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978793 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978795 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978798 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978801 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978803 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978808 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978811 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978814 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978817 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978820 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978823 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978826 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978828 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978831 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978834 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978853 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978857 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978860 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.982628 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978863 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978865 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978868 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978871 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978875 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978878 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978881 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978883 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978886 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978889 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978892 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978895 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978897 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978900 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978903 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978906 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978908 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978911 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978913 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978916 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.983134 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978918 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978921 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978923 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978927 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978930 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978932 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978935 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978937 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978940 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978948 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978951 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978953 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978956 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978959 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978962 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978965 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978967 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978970 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978972 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978974 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.983621 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978977 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978979 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978982 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978985 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978988 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978991 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978993 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978996 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.978998 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979001 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979004 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979006 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979009 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979011 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979014 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979016 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979083 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979091 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979097 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979102 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979106 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:29:41.984205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979113 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979119 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979127 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979132 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979137 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979141 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979144 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979148 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979150 2578 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979154 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979157 2578 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979160 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979163 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979171 2578 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979175 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979178 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979182 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979185 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979189 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979192 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979195 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979199 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979202 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979205 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:29:41.984725 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979208 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979211 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979214 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979218 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979222 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979225 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979227 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979231 2578 flags.go:64] FLAG: --enable-server="true" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979235 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979240 2578 flags.go:64] FLAG: --event-burst="100" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979243 2578 flags.go:64] FLAG: --event-qps="50" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979246 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979249 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979252 2578 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979256 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979259 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979262 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979266 2578 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979270 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979273 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979276 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979280 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979283 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979286 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979289 2578 flags.go:64] FLAG: --feature-gates="" Jun 03 19:29:41.985345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979293 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979296 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979299 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979302 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979305 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979308 2578 flags.go:64] FLAG: --help="false" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979311 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-28.ec2.internal" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979314 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979317 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979320 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979324 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979327 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979330 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979333 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979335 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979341 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979343 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979346 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979349 2578 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979352 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979355 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979358 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979361 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979363 2578 flags.go:64] FLAG: --lock-file="" Jun 03 19:29:41.986183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979366 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979369 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979372 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979381 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979385 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979388 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979391 2578 flags.go:64] FLAG: --logging-format="text" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979394 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979398 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979401 2578 flags.go:64] FLAG: --manifest-url="" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979404 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979408 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979411 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979415 2578 flags.go:64] FLAG: --max-pods="110" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979418 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979421 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979424 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979427 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979430 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979433 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979436 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979444 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979447 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979451 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:29:41.987235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979454 2578 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979458 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979463 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979466 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979469 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979472 2578 flags.go:64] FLAG: --port="10250" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979475 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979478 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d615fa15775ff752" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979482 2578 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979484 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979487 2578 flags.go:64] FLAG: --register-node="true" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979490 2578 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979494 2578 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979498 2578 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979501 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979504 2578 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979511 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979514 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979518 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979521 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979524 2578 flags.go:64] FLAG: --runonce="false" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979527 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979530 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979533 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979536 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:29:41.988329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979539 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979542 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979545 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979548 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979551 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979554 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979558 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979561 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979565 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979568 2578 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979570 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979576 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979579 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979582 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979586 2578 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979589 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979592 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979595 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979598 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979601 2578 flags.go:64] FLAG: --v="2" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979606 2578 flags.go:64] FLAG: --version="false" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979610 2578 flags.go:64] FLAG: --vmodule="" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979614 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.979617 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979750 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.989554 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979755 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979758 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979762 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979766 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979769 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979771 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979774 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979777 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979779 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979783 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979786 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979788 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979791 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979795 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979798 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979800 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979803 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979805 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979808 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.990351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979813 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979817 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979820 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979823 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979826 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979828 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979831 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979834 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979854 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979859 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979862 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979865 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979868 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979871 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979875 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979879 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979883 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979886 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979888 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.990981 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979892 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979895 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979898 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979901 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979904 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979907 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979909 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979914 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979917 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979919 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979922 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979924 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979927 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979930 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979933 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979935 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979938 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979941 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979943 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979946 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.991753 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979948 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979952 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979955 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979958 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979960 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979963 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979966 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979970 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979972 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979975 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979977 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979980 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979983 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979985 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979988 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979990 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979993 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979995 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.979998 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980002 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.992444 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980005 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980007 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980010 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980012 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980015 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980018 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980020 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980023 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980025 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980028 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980030 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980033 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980035 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980039 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980042 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980045 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980047 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980050 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.993179 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.980053 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.980058 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.988336 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.988362 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.988391 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.988405 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988491 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988499 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988505 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988510 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988517 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988523 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988528 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988533 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.993633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988537 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988542 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988546 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988550 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988554 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988559 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988563 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988569 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988575 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988580 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988584 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988588 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988592 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988597 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988601 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988605 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988609 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988613 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988617 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.994044 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988622 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988626 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988633 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988637 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988642 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988646 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988651 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988655 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988659 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988663 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988668 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988672 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988676 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988680 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988685 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988689 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988696 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988701 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988706 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988711 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.994525 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988716 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988720 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988725 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988730 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988735 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988739 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988743 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988747 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988751 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988755 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988760 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988764 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988768 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988772 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988777 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988783 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988787 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988791 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988795 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.995105 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988799 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988803 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988807 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988812 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988816 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988820 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988824 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988828 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988832 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988853 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988858 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988862 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988866 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988870 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988874 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988877 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988881 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988885 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988889 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988892 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.995611 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988896 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988900 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988904 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988908 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988912 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988916 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988920 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988925 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988929 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988934 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988938 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.988942 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.988949 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989149 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989157 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:29:41.996156 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989162 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989166 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989170 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989174 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989178 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989183 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989187 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989192 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989196 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989200 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989205 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989209 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989213 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989218 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989222 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989227 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989231 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989236 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989240 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989244 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:29:41.996601 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989248 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989253 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989257 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989261 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989266 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989270 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989275 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989280 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989284 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989289 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989293 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989297 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989301 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989305 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989309 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989314 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989318 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989322 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989327 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989331 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:29:41.997116 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989335 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989342 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989348 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989354 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989361 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989366 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989370 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989375 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989379 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989383 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989387 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989392 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989396 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989401 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989405 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989409 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989414 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989418 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989422 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:29:41.997917 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989426 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989431 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989436 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989440 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989448 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989453 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989457 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989461 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989466 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989470 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989474 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989479 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989483 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989487 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989491 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989495 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989499 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989504 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989508 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:29:41.998741 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989513 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989517 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989522 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989526 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989530 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989534 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989538 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989543 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989547 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989551 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989555 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989559 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989563 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989567 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989574 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989579 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:29:41.999298 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:41.989584 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.989592 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.989780 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.992916 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.994659 2578 server.go:1019] "Starting client certificate rotation" Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.994765 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.994798 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:29:41.999778 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:41.997979 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:29:42.002499 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.002479 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:29:42.031995 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.031971 2578 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:29:42.035613 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.035594 2578 log.go:25] "Validated CRI v1 image API" Jun 03 19:29:42.036503 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.036485 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:29:42.041852 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.041820 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:29:42.041940 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.041876 2578 fs.go:135] Filesystem UUIDs: map[05d82046-a532-404a-b453-683cdde7d01e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7af4d0d1-7a87-49e9-a7df-642045c5b1d3:/dev/nvme0n1p4] Jun 03 19:29:42.041940 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.041899 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:29:42.048943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.048800 2578 manager.go:216] Machine: {Timestamp:2026-06-03 19:29:42.047259479 +0000 UTC m=+0.421376512 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100106 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290b1b8580bd94a04b834613a6bc4d SystemUUID:ec290b1b-8580-bd94-a04b-834613a6bc4d BootID:d3bc6740-9b8f-4782-86e8-d280db17fc13 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:a4:56:f4:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:a4:56:f4:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:3c:73:0b:7e:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:29:42.048943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.048934 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:29:42.049114 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.049031 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:29:42.052957 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.052916 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:29:42.053150 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.052962 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:29:42.053905 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.053891 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:29:42.053962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.053913 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:29:42.053962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.053925 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:29:42.053962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.053948 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:29:42.055150 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.055136 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:29:42.059354 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059337 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:29:42.059506 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059495 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:29:42.059575 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059547 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:29:42.059575 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059568 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:29:42.059665 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059589 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:29:42.059665 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059605 2578 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:29:42.059665 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.059619 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:29:42.060047 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.060033 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:29:42.060121 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.060057 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:29:42.062610 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.062582 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:29:42.065204 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.065189 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:29:42.065265 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.065220 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:29:42.066704 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066691 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066708 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066715 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066720 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066729 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066734 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066742 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066747 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066754 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066763 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066773 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:29:42.066781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.066778 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:29:42.067637 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.067624 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:29:42.067691 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.067644 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:29:42.067691 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.067650 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d64gp" Jun 03 19:29:42.069525 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.069499 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:29:42.069578 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.069499 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:29:42.069578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.069542 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:29:42.071047 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.071034 2578 server.go:1268] "Started kubelet" Jun 03 19:29:42.071173 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.071135 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:29:42.071366 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.071247 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:29:42.071488 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.071471 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:29:42.072046 ip-10-0-140-28 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:29:42.074856 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.074815 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:29:42.074947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.074892 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:29:42.075054 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.075033 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d64gp" Jun 03 19:29:42.078686 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.077590 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-28.ec2.internal.18b5a8f14f9a726b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-28.ec2.internal,UID:ip-10-0-140-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-28.ec2.internal,},FirstTimestamp:2026-06-03 19:29:42.071005803 +0000 UTC m=+0.445123014,LastTimestamp:2026-06-03 19:29:42.071005803 +0000 UTC m=+0.445123014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-28.ec2.internal,}" Jun 03 19:29:42.079552 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.079533 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:29:42.082427 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.082410 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:29:42.082495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.082464 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:29:42.082543 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.082523 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.083240 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083212 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:29:42.083240 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083238 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:29:42.083383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083246 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:29:42.083441 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083396 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:29:42.083441 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083405 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:29:42.083545 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083528 2578 factory.go:55] Registering systemd factory Jun 03 19:29:42.083591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.083548 2578 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:29:42.085016 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.084999 2578 factory.go:153] Registering CRI-O factory Jun 03 19:29:42.085128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.085117 2578 factory.go:223] Registration of the crio container factory successfully Jun 03 19:29:42.085255 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.085243 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:29:42.085353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.085335 2578 factory.go:103] Registering Raw factory Jun 03 19:29:42.085353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.085356 2578 manager.go:1196] Started watching for new ooms in manager Jun 03 19:29:42.085924 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.085898 2578 manager.go:349] Starting recovery of all containers Jun 03 19:29:42.097196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.097065 2578 manager.go:354] Recovery completed Jun 03 19:29:42.098110 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.098093 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:42.101390 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.101355 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-28.ec2.internal\" not found" node="ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.101458 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.101443 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.103430 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.103415 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.103488 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.103441 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.103488 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.103452 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.104049 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104031 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:29:42.104049 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104048 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.104168 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104047 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:29:42.104168 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104150 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:29:42.104740 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104725 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.104800 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104756 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.104800 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.104771 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.106407 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.106395 2578 policy_none.go:49] "None policy: Start" Jun 03 19:29:42.106451 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.106412 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:29:42.106451 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.106422 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:29:42.108163 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.108151 2578 policy_none.go:47] "Start" Jun 03 19:29:42.142565 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.142544 2578 manager.go:337] "Starting Device Plugin manager" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.142587 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.142597 2578 server.go:87] "Starting device plugin registration server" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.142904 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.142914 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.143104 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.143213 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.143224 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.143669 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.143734 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.148452 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.149550 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.149582 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.149602 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.149632 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:29:42.159630 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.151982 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:42.243810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.243766 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.245050 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.245034 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.245120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.245065 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.245120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.245076 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.245120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.245099 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.250550 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.250529 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal"] Jun 03 19:29:42.250627 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.250614 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.251726 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.251712 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.251768 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.251734 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-28.ec2.internal\": node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.252454 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.252438 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.252530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.252465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.252530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.252476 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.255034 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255020 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.255180 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.255231 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255195 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.255762 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255748 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.255825 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255769 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.255825 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255778 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.255908 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255749 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.255908 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255865 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.255908 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.255881 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.258111 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.258094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.258194 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.258122 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:29:42.258861 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.258829 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:29:42.258929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.258873 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:29:42.258929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.258891 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:29:42.269482 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.269463 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.274506 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.274490 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-28.ec2.internal\" not found" node="ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.278614 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.278595 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-28.ec2.internal\" not found" node="ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.283713 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.283694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.283781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.283720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.283781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.283737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40079a1e2def053464b6f43b377957c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-28.ec2.internal\" (UID: \"40079a1e2def053464b6f43b377957c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.370581 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.370553 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.384602 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.384602 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.384717 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.384717 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc63075c723e5ea76dc361c46f95240f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal\" (UID: \"cc63075c723e5ea76dc361c46f95240f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.384717 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40079a1e2def053464b6f43b377957c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-28.ec2.internal\" (UID: \"40079a1e2def053464b6f43b377957c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.384717 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.384695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40079a1e2def053464b6f43b377957c7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-28.ec2.internal\" (UID: \"40079a1e2def053464b6f43b377957c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.471691 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.471658 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.572515 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.572484 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.578669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.578643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.584540 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.584523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:42.673555 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.673459 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.774006 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.773976 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.874547 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.874518 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.975124 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:42.975038 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:42.993560 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.993533 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:29:42.993700 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.993682 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:29:42.993743 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:42.993707 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:29:43.075784 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:43.075747 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:43.083446 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.083041 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:24:42 +0000 UTC" deadline="2028-01-25 17:52:28.040977809 +0000 UTC" Jun 03 19:29:43.083446 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.083070 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14422h22m44.957911973s" Jun 03 19:29:43.176477 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:43.176443 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:43.189226 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.189201 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:43.222585 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:43.222534 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40079a1e2def053464b6f43b377957c7.slice/crio-c6ab471c730816ceb77d48fcac6ec72e13aef1e64beb71f85a4a7527cdb03b49 WatchSource:0}: Error finding container c6ab471c730816ceb77d48fcac6ec72e13aef1e64beb71f85a4a7527cdb03b49: Status 404 returned error can't find the container with id c6ab471c730816ceb77d48fcac6ec72e13aef1e64beb71f85a4a7527cdb03b49 Jun 03 19:29:43.222988 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:43.222962 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc63075c723e5ea76dc361c46f95240f.slice/crio-04f3dde1ba673ac024357727b7ec1bde43d28ea372a4b71ca89a763d415e96d3 WatchSource:0}: Error finding container 04f3dde1ba673ac024357727b7ec1bde43d28ea372a4b71ca89a763d415e96d3: Status 404 returned error can't find the container with id 04f3dde1ba673ac024357727b7ec1bde43d28ea372a4b71ca89a763d415e96d3 Jun 03 19:29:43.227684 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.227667 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:29:43.276859 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:43.276805 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:43.377385 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:43.377355 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-28.ec2.internal\" not found" Jun 03 19:29:43.441296 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.441263 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:43.483457 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.483394 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" Jun 03 19:29:43.496323 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.496295 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:29:43.497629 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.497614 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" Jun 03 19:29:43.508171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.508144 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:29:43.817322 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:43.817229 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:44.060811 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.060778 2578 apiserver.go:52] "Watching apiserver" Jun 03 19:29:44.067898 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.067782 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:29:44.069372 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.069345 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5q6z5","kube-system/konnectivity-agent-rxjtv","kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal","openshift-dns/node-resolver-6bzfs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal","openshift-network-operator/iptables-alerter-7b8hd","openshift-ovn-kubernetes/ovnkube-node-prsnq","kube-system/global-pull-secret-syncer-xt6ns","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7","openshift-cluster-node-tuning-operator/tuned-vjmnh","openshift-image-registry/node-ca-pvhqt","openshift-multus/multus-additional-cni-plugins-6ftml","openshift-multus/multus-fkgm7","openshift-multus/network-metrics-daemon-sksjb"] Jun 03 19:29:44.073743 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.073654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.076119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.076093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.076702 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.076680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:29:44.076812 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.076799 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.076966 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.076949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wsl9\"" Jun 03 19:29:44.077043 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.076999 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:29:44.077043 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.077007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:29:44.077147 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.077137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.077198 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.077151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:29:44.078291 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.078023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.078291 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.078114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:44.078771 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.078575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.078771 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.078598 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:29:44.078771 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.078639 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qkvc9\"" Jun 03 19:29:44.078771 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.078704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.081320 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.080512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.082500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.082580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.082974 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.083147 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.083194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9f7l\"" Jun 03 19:29:44.084578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.083318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.084943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.084691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.086798 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.086767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.087459 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.087102 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.087459 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.087177 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:29:44.087459 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.087106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.087803 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.087782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-465nq\"" Jun 03 19:29:44.089604 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.089582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.090264 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.089878 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:29:44.090264 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.090203 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.090795 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.090747 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.091144 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.091111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbcbc\"" Jun 03 19:29:44.092379 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.092154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.092526 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.092448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.092808 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.092789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:29:44.092934 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.092797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-765fd\"" Jun 03 19:29:44.092934 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.092914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:29:44.093217 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093198 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-serviceca\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-dbus\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-kubelet\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-slash\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-netns\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-netd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.093734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ec455d-8439-467f-aa9a-8e69d52a0d72-tmp-dir\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovn-node-metrics-cert\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrh5\" (UniqueName: \"kubernetes.io/projected/400593bd-b9ff-480b-97a7-7df42e3ed59e-kube-api-access-fgrh5\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcksm\" (UniqueName: \"kubernetes.io/projected/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-kube-api-access-xcksm\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-etc-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.093998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-node-log\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-script-lib\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7pwb\" (UniqueName: \"kubernetes.io/projected/f194ab89-508e-4ddb-af2c-d83eaa470455-kube-api-access-d7pwb\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2ec455d-8439-467f-aa9a-8e69d52a0d72-hosts-file\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.094160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-iptables-alerter-script\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-kube-api-access-snq7t\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-systemd-units\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-log-socket\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lqh9\" (UniqueName: \"kubernetes.io/projected/d2ec455d-8439-467f-aa9a-8e69d52a0d72-kube-api-access-5lqh9\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-systemd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-config\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-host-slash\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-kubelet-config\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094641 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7xw9\"" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-bin\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-env-overrides\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-host\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-var-lib-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.094992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.094865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-ovn\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.095780 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.095084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.095780 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.095391 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:29:44.097273 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.097253 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvxl9\"" Jun 03 19:29:44.097391 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.097372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:29:44.097628 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.097606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:44.097734 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.097697 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:44.098619 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.098466 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:29:44.100878 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.100856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.103131 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.103071 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:29:44.105302 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.104571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:29:44.105302 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.104706 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n5dst\"" Jun 03 19:29:44.126270 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.126244 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-852wp" Jun 03 19:29:44.134894 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.134865 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-852wp" Jun 03 19:29:44.153516 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.153471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" event={"ID":"40079a1e2def053464b6f43b377957c7","Type":"ContainerStarted","Data":"c6ab471c730816ceb77d48fcac6ec72e13aef1e64beb71f85a4a7527cdb03b49"} Jun 03 19:29:44.154509 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.154488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" event={"ID":"cc63075c723e5ea76dc361c46f95240f","Type":"ContainerStarted","Data":"04f3dde1ba673ac024357727b7ec1bde43d28ea372a4b71ca89a763d415e96d3"} Jun 03 19:29:44.184264 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.184237 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:29:44.195808 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-serviceca\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-etc-kubernetes\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-kubernetes\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-conf\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-kubelet\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.195972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-netd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-registration-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-lib-modules\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-kubelet\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-netd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ec455d-8439-467f-aa9a-8e69d52a0d72-tmp-dir\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrh5\" (UniqueName: \"kubernetes.io/projected/400593bd-b9ff-480b-97a7-7df42e3ed59e-kube-api-access-fgrh5\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.196255 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.196329 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:44.696309721 +0000 UTC m=+3.070426736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcksm\" (UniqueName: \"kubernetes.io/projected/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-kube-api-access-xcksm\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2ec455d-8439-467f-aa9a-8e69d52a0d72-tmp-dir\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-multus\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.196422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-serviceca\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-etc-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-bin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-etc-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.196640 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-socket-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.196737 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:44.696720799 +0000 UTC m=+3.070837813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-sys\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2ec455d-8439-467f-aa9a-8e69d52a0d72-hosts-file\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-log-socket\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-systemd\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-run\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-tmp\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-log-socket\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.196929 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kql75\" (UniqueName: \"kubernetes.io/projected/d2441219-876b-48a7-9656-6bbe829b05a0-kube-api-access-kql75\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cnibin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.196996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysconfig\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2ec455d-8439-467f-aa9a-8e69d52a0d72-hosts-file\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-host\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-system-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-socket-dir-parent\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-host\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64dd5f83-bbf6-4991-b673-67d124f7483a-agent-certs\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64dd5f83-bbf6-4991-b673-67d124f7483a-konnectivity-ca\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-system-cni-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-var-lib-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-netns\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-device-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-var-lib-kubelet\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.197687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-host\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-var-lib-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-tuned\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-cnibin\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-dbus\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-slash\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-netns\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-conf-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-slash\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-dbus\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovn-node-metrics-cert\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-netns\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-os-release\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.198442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cni-binary-copy\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-daemon-config\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-openvswitch\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-node-log\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-script-lib\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-node-log\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7pwb\" (UniqueName: \"kubernetes.io/projected/f194ab89-508e-4ddb-af2c-d83eaa470455-kube-api-access-d7pwb\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-sys-fs\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-iptables-alerter-script\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-kube-api-access-snq7t\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197913 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-systemd-units\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.197987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-kubelet\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-modprobe-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-systemd-units\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8mm\" (UniqueName: \"kubernetes.io/projected/6f48ce25-d4f6-43e6-8809-df225af2e86d-kube-api-access-qz8mm\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lqh9\" (UniqueName: \"kubernetes.io/projected/d2ec455d-8439-467f-aa9a-8e69d52a0d72-kube-api-access-5lqh9\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-run-ovn-kubernetes\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-systemd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-systemd\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-config\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-hostroot\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbtg\" (UniqueName: \"kubernetes.io/projected/e8d9b817-dd2d-451d-9408-62cb6191b2cf-kube-api-access-hdbtg\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-host-slash\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-multus-certs\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-os-release\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-kubelet-config\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-bin\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-env-overrides\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.199869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxvvn\" (UniqueName: \"kubernetes.io/projected/9a34c984-d6eb-460a-877b-be4644b0efd8-kube-api-access-hxvvn\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10966712-2deb-4b32-90d8-926d107c2de2-kubelet-config\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-ovn\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-host-slash\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198593 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-run-ovn\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/400593bd-b9ff-480b-97a7-7df42e3ed59e-host-cni-bin\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-iptables-alerter-script\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-config\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovnkube-script-lib\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.200431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.198991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/400593bd-b9ff-480b-97a7-7df42e3ed59e-env-overrides\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.201299 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.201277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/400593bd-b9ff-480b-97a7-7df42e3ed59e-ovn-node-metrics-cert\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.205600 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.205570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcksm\" (UniqueName: \"kubernetes.io/projected/5633f6c7-559e-4400-b6c5-feb3bb2c9ee0-kube-api-access-xcksm\") pod \"node-ca-pvhqt\" (UID: \"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0\") " pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.205797 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.205775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrh5\" (UniqueName: \"kubernetes.io/projected/400593bd-b9ff-480b-97a7-7df42e3ed59e-kube-api-access-fgrh5\") pod \"ovnkube-node-prsnq\" (UID: \"400593bd-b9ff-480b-97a7-7df42e3ed59e\") " pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.206346 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.206323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lqh9\" (UniqueName: \"kubernetes.io/projected/d2ec455d-8439-467f-aa9a-8e69d52a0d72-kube-api-access-5lqh9\") pod \"node-resolver-6bzfs\" (UID: \"d2ec455d-8439-467f-aa9a-8e69d52a0d72\") " pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.206623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.206595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/d15d73b0-5236-4a47-af07-c2a5da9f5d3d-kube-api-access-snq7t\") pod \"iptables-alerter-7b8hd\" (UID: \"d15d73b0-5236-4a47-af07-c2a5da9f5d3d\") " pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.206788 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.206769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7pwb\" (UniqueName: \"kubernetes.io/projected/f194ab89-508e-4ddb-af2c-d83eaa470455-kube-api-access-d7pwb\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.299348 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-multus\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299348 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-bin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-multus\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-socket-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-cni-bin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-socket-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-sys\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-systemd\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-run\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-tmp\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-sys\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299738 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-systemd\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.299821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299793 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-run\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kql75\" (UniqueName: \"kubernetes.io/projected/d2441219-876b-48a7-9656-6bbe829b05a0-kube-api-access-kql75\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cnibin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysconfig\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-system-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.299947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-socket-dir-parent\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-socket-dir-parent\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysconfig\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64dd5f83-bbf6-4991-b673-67d124f7483a-agent-certs\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-system-cni-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cnibin\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64dd5f83-bbf6-4991-b673-67d124f7483a-konnectivity-ca\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-system-cni-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-netns\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.300205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300170 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-system-cni-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-device-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-var-lib-kubelet\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-host\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-netns\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-tuned\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-cnibin\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-var-lib-kubelet\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-conf-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-device-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300390 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-cnibin\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-os-release\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-conf-dir\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cni-binary-copy\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-daemon-config\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-host\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-sys-fs\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-kubelet\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-modprobe-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8mm\" (UniqueName: \"kubernetes.io/projected/6f48ce25-d4f6-43e6-8809-df225af2e86d-kube-api-access-qz8mm\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-hostroot\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbtg\" (UniqueName: \"kubernetes.io/projected/e8d9b817-dd2d-451d-9408-62cb6191b2cf-kube-api-access-hdbtg\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/64dd5f83-bbf6-4991-b673-67d124f7483a-konnectivity-ca\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-multus-certs\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-os-release\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-run-multus-certs\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-host-var-lib-kubelet\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.301860 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvvn\" (UniqueName: \"kubernetes.io/projected/9a34c984-d6eb-460a-877b-be4644b0efd8-kube-api-access-hxvvn\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-etc-kubernetes\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-etc-kubernetes\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.300945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2441219-876b-48a7-9656-6bbe829b05a0-os-release\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-cni-binary-copy\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-modprobe-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-os-release\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8d9b817-dd2d-451d-9408-62cb6191b2cf-hostroot\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-sys-fs\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-kubernetes\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-conf\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-registration-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-lib-modules\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-d\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a34c984-d6eb-460a-877b-be4644b0efd8-registration-dir\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.302567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8d9b817-dd2d-451d-9408-62cb6191b2cf-multus-daemon-config\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-kubernetes\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-lib-modules\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.301804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-sysctl-conf\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.302194 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.302248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2441219-876b-48a7-9656-6bbe829b05a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.302635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-tmp\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.303245 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.303161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/64dd5f83-bbf6-4991-b673-67d124f7483a-agent-certs\") pod \"konnectivity-agent-rxjtv\" (UID: \"64dd5f83-bbf6-4991-b673-67d124f7483a\") " pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.303735 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.303713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f48ce25-d4f6-43e6-8809-df225af2e86d-etc-tuned\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.306097 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.306080 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:44.306214 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.306104 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:44.306214 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.306119 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:44.306214 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.306194 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:44.806176994 +0000 UTC m=+3.180294034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:44.308576 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.308547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kql75\" (UniqueName: \"kubernetes.io/projected/d2441219-876b-48a7-9656-6bbe829b05a0-kube-api-access-kql75\") pod \"multus-additional-cni-plugins-6ftml\" (UID: \"d2441219-876b-48a7-9656-6bbe829b05a0\") " pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.309505 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.309482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbtg\" (UniqueName: \"kubernetes.io/projected/e8d9b817-dd2d-451d-9408-62cb6191b2cf-kube-api-access-hdbtg\") pod \"multus-fkgm7\" (UID: \"e8d9b817-dd2d-451d-9408-62cb6191b2cf\") " pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.309753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.309727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxvvn\" (UniqueName: \"kubernetes.io/projected/9a34c984-d6eb-460a-877b-be4644b0efd8-kube-api-access-hxvvn\") pod \"aws-ebs-csi-driver-node-mxjl7\" (UID: \"9a34c984-d6eb-460a-877b-be4644b0efd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.309753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.309741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8mm\" (UniqueName: \"kubernetes.io/projected/6f48ce25-d4f6-43e6-8809-df225af2e86d-kube-api-access-qz8mm\") pod \"tuned-vjmnh\" (UID: \"6f48ce25-d4f6-43e6-8809-df225af2e86d\") " pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.389154 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.389067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:29:44.399625 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.399597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvhqt" Jun 03 19:29:44.405276 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.405251 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:29:44.407506 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.407483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bzfs" Jun 03 19:29:44.416137 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.416107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7b8hd" Jun 03 19:29:44.423821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.423794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" Jun 03 19:29:44.432587 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.432562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fkgm7" Jun 03 19:29:44.440487 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.440458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:29:44.446484 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.446463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" Jun 03 19:29:44.451549 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.451513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6ftml" Jun 03 19:29:44.704158 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.704056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:44.704158 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.704118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:44.704364 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.704212 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:44.704364 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.704245 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:44.704364 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.704286 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:45.70426663 +0000 UTC m=+4.078383705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:44.704364 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.704305 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:45.704295334 +0000 UTC m=+4.078412352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:44.905158 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:44.905122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:44.905318 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.905266 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:44.905318 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.905287 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:44.905318 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.905299 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:44.905442 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:44.905358 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:45.905341184 +0000 UTC m=+4.279458223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:45.137998 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:45.137917 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:24:44 +0000 UTC" deadline="2028-02-06 20:38:39.544768548 +0000 UTC" Jun 03 19:29:45.137998 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:45.137950 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14713h8m54.406822171s" Jun 03 19:29:45.167095 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.167065 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ec455d_8439_467f_aa9a_8e69d52a0d72.slice/crio-b2e5911f150e3bd68ea7ea0074dc2fe3f83a7268c005480b72a5162167fd7d02 WatchSource:0}: Error finding container b2e5911f150e3bd68ea7ea0074dc2fe3f83a7268c005480b72a5162167fd7d02: Status 404 returned error can't find the container with id b2e5911f150e3bd68ea7ea0074dc2fe3f83a7268c005480b72a5162167fd7d02 Jun 03 19:29:45.167818 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.167798 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400593bd_b9ff_480b_97a7_7df42e3ed59e.slice/crio-7242fd005c5e4dcca79cec38bcec9050998ace266d5ad9904a1097290e6d7852 WatchSource:0}: Error finding container 7242fd005c5e4dcca79cec38bcec9050998ace266d5ad9904a1097290e6d7852: Status 404 returned error can't find the container with id 7242fd005c5e4dcca79cec38bcec9050998ace266d5ad9904a1097290e6d7852 Jun 03 19:29:45.168784 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.168747 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15d73b0_5236_4a47_af07_c2a5da9f5d3d.slice/crio-47d4de6ee6cff1a8e4c3c30e06661dc1e1c4cfa96afee0b8e6b7ce180673ddea WatchSource:0}: Error finding container 47d4de6ee6cff1a8e4c3c30e06661dc1e1c4cfa96afee0b8e6b7ce180673ddea: Status 404 returned error can't find the container with id 47d4de6ee6cff1a8e4c3c30e06661dc1e1c4cfa96afee0b8e6b7ce180673ddea Jun 03 19:29:45.172756 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.172728 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d9b817_dd2d_451d_9408_62cb6191b2cf.slice/crio-192b7b855517323d5bcaca6ecbf1b6056ae4455d150c8e3a093328c52def501d WatchSource:0}: Error finding container 192b7b855517323d5bcaca6ecbf1b6056ae4455d150c8e3a093328c52def501d: Status 404 returned error can't find the container with id 192b7b855517323d5bcaca6ecbf1b6056ae4455d150c8e3a093328c52def501d Jun 03 19:29:45.195023 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.194993 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64dd5f83_bbf6_4991_b673_67d124f7483a.slice/crio-aa6d5cc49f2d3f888ef1416e79d17710d367fc4163ec7477aacc45d85f9df9c8 WatchSource:0}: Error finding container aa6d5cc49f2d3f888ef1416e79d17710d367fc4163ec7477aacc45d85f9df9c8: Status 404 returned error can't find the container with id aa6d5cc49f2d3f888ef1416e79d17710d367fc4163ec7477aacc45d85f9df9c8 Jun 03 19:29:45.195727 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.195704 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f48ce25_d4f6_43e6_8809_df225af2e86d.slice/crio-e35ba33afcd8e12cef52841b9399540f04b174753262757c0b8750a18015a244 WatchSource:0}: Error finding container e35ba33afcd8e12cef52841b9399540f04b174753262757c0b8750a18015a244: Status 404 returned error can't find the container with id e35ba33afcd8e12cef52841b9399540f04b174753262757c0b8750a18015a244 Jun 03 19:29:45.197066 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.196953 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a34c984_d6eb_460a_877b_be4644b0efd8.slice/crio-cd2021f9a59e802d18572050e4065d47a9899eb0e71b195aa8d8ab8429a854db WatchSource:0}: Error finding container cd2021f9a59e802d18572050e4065d47a9899eb0e71b195aa8d8ab8429a854db: Status 404 returned error can't find the container with id cd2021f9a59e802d18572050e4065d47a9899eb0e71b195aa8d8ab8429a854db Jun 03 19:29:45.197635 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.197614 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2441219_876b_48a7_9656_6bbe829b05a0.slice/crio-ead3bd5630cb3e23bc3b4a7da0309a6b352295e2f48c99c1ac1a870bc02e8f35 WatchSource:0}: Error finding container ead3bd5630cb3e23bc3b4a7da0309a6b352295e2f48c99c1ac1a870bc02e8f35: Status 404 returned error can't find the container with id ead3bd5630cb3e23bc3b4a7da0309a6b352295e2f48c99c1ac1a870bc02e8f35 Jun 03 19:29:45.198265 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:29:45.198212 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5633f6c7_559e_4400_b6c5_feb3bb2c9ee0.slice/crio-3b65fe3a6a27025ebbb5ba1fc76c39c86be5a9c1205f061e1a7db4841509aa32 WatchSource:0}: Error finding container 3b65fe3a6a27025ebbb5ba1fc76c39c86be5a9c1205f061e1a7db4841509aa32: Status 404 returned error can't find the container with id 3b65fe3a6a27025ebbb5ba1fc76c39c86be5a9c1205f061e1a7db4841509aa32 Jun 03 19:29:45.712296 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:45.711974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:45.712296 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:45.712264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:45.712501 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.712442 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:45.712561 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.712505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:47.712486204 +0000 UTC m=+6.086603222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:45.713025 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.712934 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:45.713025 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.712990 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:47.712974226 +0000 UTC m=+6.087091256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:45.914074 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:45.914036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:45.914257 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.914232 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:45.914257 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.914250 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:45.914375 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.914263 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:45.914375 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:45.914323 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:47.914304104 +0000 UTC m=+6.288421143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:46.142731 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.140781 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:24:44 +0000 UTC" deadline="2027-11-30 01:00:28.737623863 +0000 UTC" Jun 03 19:29:46.142731 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.140858 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13061h30m42.596770795s" Jun 03 19:29:46.152352 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.152322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:46.152506 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:46.152454 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:46.152911 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.152887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:46.153009 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:46.152990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:46.153073 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.153055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:46.153188 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:46.153136 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:46.178192 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.177262 2578 generic.go:356] "Generic (PLEG): container finished" podID="cc63075c723e5ea76dc361c46f95240f" containerID="2e07bb0b051d913629dc011cc003c7497ba6da3a2b7addfbe5be6fec09434ed8" exitCode=0 Jun 03 19:29:46.178192 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.177364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" event={"ID":"cc63075c723e5ea76dc361c46f95240f","Type":"ContainerDied","Data":"2e07bb0b051d913629dc011cc003c7497ba6da3a2b7addfbe5be6fec09434ed8"} Jun 03 19:29:46.188046 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.188004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerStarted","Data":"ead3bd5630cb3e23bc3b4a7da0309a6b352295e2f48c99c1ac1a870bc02e8f35"} Jun 03 19:29:46.219781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.219745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" event={"ID":"9a34c984-d6eb-460a-877b-be4644b0efd8","Type":"ContainerStarted","Data":"cd2021f9a59e802d18572050e4065d47a9899eb0e71b195aa8d8ab8429a854db"} Jun 03 19:29:46.229013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.228973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b8hd" event={"ID":"d15d73b0-5236-4a47-af07-c2a5da9f5d3d","Type":"ContainerStarted","Data":"47d4de6ee6cff1a8e4c3c30e06661dc1e1c4cfa96afee0b8e6b7ce180673ddea"} Jun 03 19:29:46.234652 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.234613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"7242fd005c5e4dcca79cec38bcec9050998ace266d5ad9904a1097290e6d7852"} Jun 03 19:29:46.243874 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.242766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bzfs" event={"ID":"d2ec455d-8439-467f-aa9a-8e69d52a0d72","Type":"ContainerStarted","Data":"b2e5911f150e3bd68ea7ea0074dc2fe3f83a7268c005480b72a5162167fd7d02"} Jun 03 19:29:46.259350 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.259269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvhqt" event={"ID":"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0","Type":"ContainerStarted","Data":"3b65fe3a6a27025ebbb5ba1fc76c39c86be5a9c1205f061e1a7db4841509aa32"} Jun 03 19:29:46.276253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.276215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" event={"ID":"6f48ce25-d4f6-43e6-8809-df225af2e86d","Type":"ContainerStarted","Data":"e35ba33afcd8e12cef52841b9399540f04b174753262757c0b8750a18015a244"} Jun 03 19:29:46.297413 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.297372 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxjtv" event={"ID":"64dd5f83-bbf6-4991-b673-67d124f7483a","Type":"ContainerStarted","Data":"aa6d5cc49f2d3f888ef1416e79d17710d367fc4163ec7477aacc45d85f9df9c8"} Jun 03 19:29:46.318520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.318475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fkgm7" event={"ID":"e8d9b817-dd2d-451d-9408-62cb6191b2cf","Type":"ContainerStarted","Data":"192b7b855517323d5bcaca6ecbf1b6056ae4455d150c8e3a093328c52def501d"} Jun 03 19:29:46.343132 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.343088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" event={"ID":"40079a1e2def053464b6f43b377957c7","Type":"ContainerStarted","Data":"f8ab0e3038a9c44a53e0ea09f1ecc5bd43193eea275621adab5013c26f77b166"} Jun 03 19:29:46.359499 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:46.359437 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-28.ec2.internal" podStartSLOduration=3.359413609 podStartE2EDuration="3.359413609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:46.358381324 +0000 UTC m=+4.732498356" watchObservedRunningTime="2026-06-03 19:29:46.359413609 +0000 UTC m=+4.733530648" Jun 03 19:29:47.373229 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:47.373143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" event={"ID":"cc63075c723e5ea76dc361c46f95240f","Type":"ContainerStarted","Data":"b7a9a8344e0316ca74ca1557c33ed56c5fbe1ac06bbe1be15049ae5522a22635"} Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:47.727693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:47.727745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.727899 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.727967 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:51.727947101 +0000 UTC m=+10.102064135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.728340 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:47.728474 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.728387 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:51.728371924 +0000 UTC m=+10.102488940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:47.930376 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:47.930336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:47.930573 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.930503 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:47.930573 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.930522 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:47.930573 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.930535 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:47.930723 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:47.930595 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:51.930576631 +0000 UTC m=+10.304693650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:48.150640 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:48.150556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:48.150808 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:48.150698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:48.151148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:48.151126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:48.151260 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:48.151240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:48.151322 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:48.151293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:48.151395 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:48.151363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:50.153516 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:50.153473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:50.153949 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:50.153640 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:50.153949 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:50.153723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:50.153949 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:50.153802 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:50.153949 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:50.153886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:50.154138 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:50.153965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:51.764201 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:51.764148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:51.764201 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:51.764204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:51.764736 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.764320 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:51.764736 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.764369 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:59.764356155 +0000 UTC m=+18.138473170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:51.764736 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.764410 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:51.764736 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.764432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:59.764425473 +0000 UTC m=+18.138542489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:51.965563 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:51.965524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:51.965745 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.965717 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:29:51.965745 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.965739 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:29:51.965871 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.965753 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:51.965871 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:51.965809 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:29:59.965793484 +0000 UTC m=+18.339910521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:52.153688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:52.153804 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:52.153908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:52.153937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:52.154004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:52.154208 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:52.154088 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:54.154097 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:54.154063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:54.154567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:54.154113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:54.154567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:54.154176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:54.154567 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:54.154195 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:54.154567 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:54.154292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:54.154567 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:54.154381 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:56.150742 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:56.150701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:56.151225 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:56.150712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:56.151225 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:56.150834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:56.151225 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:56.150829 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:56.151225 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:56.150978 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:56.151225 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:56.151062 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:58.150116 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:58.150081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:29:58.150680 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:58.150082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:58.150680 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:58.150215 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:29:58.150680 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:58.150081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:58.150680 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:58.150286 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:29:58.150680 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:58.150399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:29:59.821759 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:59.821718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:29:59.821759 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:29:59.821763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:29:59.822274 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:59.821922 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:59.822274 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:59.821922 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:29:59.822274 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:59.821987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:15.821968898 +0000 UTC m=+34.196085916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:29:59.822274 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:29:59.822002 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:15.821996209 +0000 UTC m=+34.196113223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:00.023160 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:00.023119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:00.023317 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.023293 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:00.023317 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.023316 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:00.023433 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.023329 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:00.023433 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.023393 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:16.023374049 +0000 UTC m=+34.397491076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:00.150263 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:00.150178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:00.150429 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:00.150178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:00.150429 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.150304 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:00.150429 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:00.150178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:00.150429 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.150380 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:00.150632 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:00.150489 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:02.151519 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:02.151425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:02.151951 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:02.151524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:02.151951 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:02.151551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:02.151951 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:02.151581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:02.151951 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:02.151625 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:02.151951 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:02.151698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:03.406603 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.406411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" event={"ID":"6f48ce25-d4f6-43e6-8809-df225af2e86d","Type":"ContainerStarted","Data":"66999658a089e736a191ba0f914f0fe3148a5bf5c6c64ef0ad15ad5b9245d2e2"} Jun 03 19:30:03.407999 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.407971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxjtv" event={"ID":"64dd5f83-bbf6-4991-b673-67d124f7483a","Type":"ContainerStarted","Data":"a2b602aaea7b6397711872ed8babf157eceb4b4e37984137675becbc0dc9596a"} Jun 03 19:30:03.409368 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.409335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fkgm7" event={"ID":"e8d9b817-dd2d-451d-9408-62cb6191b2cf","Type":"ContainerStarted","Data":"424f10ccfce0e44172f1e7fc6712ffcae79b75568cd22d53f1ffa3992fa63a9d"} Jun 03 19:30:03.410834 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.410813 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="9641eb32caabe930d72c68ad258fe22ae83741f3a54eb0684c6354139f487c29" exitCode=0 Jun 03 19:30:03.410921 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.410878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"9641eb32caabe930d72c68ad258fe22ae83741f3a54eb0684c6354139f487c29"} Jun 03 19:30:03.412821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.412799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" event={"ID":"9a34c984-d6eb-460a-877b-be4644b0efd8","Type":"ContainerStarted","Data":"3fb2c125587fb926f5a7667460f88ea8e6873f1c137560f0b7d328c506d59f83"} Jun 03 19:30:03.414647 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.414629 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:30:03.415020 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.415000 2578 generic.go:356] "Generic (PLEG): container finished" podID="400593bd-b9ff-480b-97a7-7df42e3ed59e" containerID="3e2b0f238b17e3a94ab3f3ccbaf24ecccfc5ae2e76adda6ccd4ca92ba3a847ed" exitCode=1 Jun 03 19:30:03.415083 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.415051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"d5a23a38beaff7bddd262d5a087d1a26c7205cacabe47c8d0bbb4fedc6a9597c"} Jun 03 19:30:03.415147 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.415128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerDied","Data":"3e2b0f238b17e3a94ab3f3ccbaf24ecccfc5ae2e76adda6ccd4ca92ba3a847ed"} Jun 03 19:30:03.415265 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.415184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"88184ec339b26e3e7cca99294cb91fbd6c15ff739a2ee80cd7a418eee7386385"} Jun 03 19:30:03.416399 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.416365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bzfs" event={"ID":"d2ec455d-8439-467f-aa9a-8e69d52a0d72","Type":"ContainerStarted","Data":"ff0f35e6ebb8ce4cde5e1464d339076c0beb72edf142cd93a2459afa6633c23e"} Jun 03 19:30:03.417781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.417762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvhqt" event={"ID":"5633f6c7-559e-4400-b6c5-feb3bb2c9ee0","Type":"ContainerStarted","Data":"645846cec8e86a24ca25fd88d2e8a8e1cc60abb499c2b5b54088fffaad6471d2"} Jun 03 19:30:03.423550 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.423506 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-28.ec2.internal" podStartSLOduration=20.423495381 podStartE2EDuration="20.423495381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:47.391937021 +0000 UTC m=+5.766054059" watchObservedRunningTime="2026-06-03 19:30:03.423495381 +0000 UTC m=+21.797612418" Jun 03 19:30:03.423791 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.423773 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vjmnh" podStartSLOduration=3.7638679919999998 podStartE2EDuration="21.423766798s" totalImagesPullingTime="17.659898806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:03.423371992 +0000 UTC m=+21.797489187" watchObservedRunningTime="2026-06-03 19:30:03.423766798 +0000 UTC m=+21.797883834" Jun 03 19:30:03.437785 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.437658 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxjtv" podStartSLOduration=3.779643149 podStartE2EDuration="21.437642478s" totalImagesPullingTime="17.657999329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:03.437290168 +0000 UTC m=+21.811407206" watchObservedRunningTime="2026-06-03 19:30:03.437642478 +0000 UTC m=+21.811759514" Jun 03 19:30:03.474042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.473995 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6bzfs" podStartSLOduration=3.789045209 podStartE2EDuration="21.473980077s" totalImagesPullingTime="17.684934868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:03.473589275 +0000 UTC m=+21.847706312" watchObservedRunningTime="2026-06-03 19:30:03.473980077 +0000 UTC m=+21.848097114" Jun 03 19:30:03.493909 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.493830 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fkgm7" podStartSLOduration=3.753058881 podStartE2EDuration="21.493815693s" totalImagesPullingTime="17.740756812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:03.493565933 +0000 UTC m=+21.867682983" watchObservedRunningTime="2026-06-03 19:30:03.493815693 +0000 UTC m=+21.867932729" Jun 03 19:30:03.507694 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:03.507650 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pvhqt" podStartSLOduration=3.852837284 podStartE2EDuration="21.507633996s" totalImagesPullingTime="17.654796712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:03.507593769 +0000 UTC m=+21.881710807" watchObservedRunningTime="2026-06-03 19:30:03.507633996 +0000 UTC m=+21.881751032" Jun 03 19:30:04.150566 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.150484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:04.150789 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.150484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:04.150789 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:04.150598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:04.150789 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.150620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:04.150789 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:04.150717 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:04.151025 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:04.150795 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:04.422644 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.422611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7b8hd" event={"ID":"d15d73b0-5236-4a47-af07-c2a5da9f5d3d","Type":"ContainerStarted","Data":"3c1becfcdfc5e141eec201b21f8c26e90965e163ca3dcd0760763b84720f18a6"} Jun 03 19:30:04.425984 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.425960 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:30:04.426655 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.426625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"aa90984ccd309624b16cfd42308cb57f4b3110185ead351a1c0fd527f03c0578"} Jun 03 19:30:04.426766 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.426712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"0a3c36ee25d7e1b6d30b771640b7425633a180764d40ef5bcefc17e1a3f087a1"} Jun 03 19:30:04.426766 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.426761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"aef6789768beabd76c31d1dab1f9bd2bdcf2adbc75556b8377f9871b5212f59e"} Jun 03 19:30:04.437624 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.437574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7b8hd" podStartSLOduration=4.753090913 podStartE2EDuration="22.437559314s" totalImagesPullingTime="17.684468401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:04.43752425 +0000 UTC m=+22.811641287" watchObservedRunningTime="2026-06-03 19:30:04.437559314 +0000 UTC m=+22.811676351" Jun 03 19:30:04.501299 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.501267 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:30:04.702184 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.702097 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:30:04.702786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:04.702764 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:30:05.158551 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:05.158433 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:30:04.501290587Z","UUID":"3e8997b1-99b7-4331-be2c-9574b3f1cb13","Handler":null,"Name":"","Endpoint":""} Jun 03 19:30:05.160262 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:05.160142 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:30:05.160262 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:05.160192 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:30:05.431222 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:05.431079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" event={"ID":"9a34c984-d6eb-460a-877b-be4644b0efd8","Type":"ContainerStarted","Data":"12b9caea5b2a3090242cf3eb1cfcf96e6a4f1d503619c52b1b385858b9335ad2"} Jun 03 19:30:06.150694 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.150431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:06.150902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.150431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:06.150902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:06.150816 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:06.150902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.150431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:06.151065 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:06.150894 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:06.151065 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:06.150961 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:06.436243 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.436149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" event={"ID":"9a34c984-d6eb-460a-877b-be4644b0efd8","Type":"ContainerStarted","Data":"777372c4dbeb9c868e191217f70d01e9cc8cb5ce946235c1596d9b6356cb9b3d"} Jun 03 19:30:06.439445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.439407 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:30:06.439895 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.439877 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 19:30:06.439895 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.439881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"e7102080d3f952adbbf6680da69f14c02e1d294ecff002cfe09faa52099ef292"} Jun 03 19:30:06.453934 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:06.453878 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxjl7" podStartSLOduration=4.731839637 podStartE2EDuration="24.453861604s" totalImagesPullingTime="19.722021967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:06.453601645 +0000 UTC m=+24.827718684" watchObservedRunningTime="2026-06-03 19:30:06.453861604 +0000 UTC m=+24.827978638" Jun 03 19:30:08.151185 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.150925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:08.151185 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.150925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:08.151906 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:08.151196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:08.151906 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.150927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:08.151906 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:08.151262 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:08.151906 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:08.151358 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:08.229329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.229291 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:30:08.229497 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.229426 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 19:30:08.229995 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.229974 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxjtv" Jun 03 19:30:08.445868 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.445765 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="7ff83ad69876f0ea043ecebe0b7451759cf2cfa10cec13ed90c57edb794bc32d" exitCode=0 Jun 03 19:30:08.445868 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.445855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"7ff83ad69876f0ea043ecebe0b7451759cf2cfa10cec13ed90c57edb794bc32d"} Jun 03 19:30:08.449235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.449219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:30:08.449631 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.449604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"84339c86af3d052824a7a6baa4cbb02dd36ff04d0deedabd9c380b03ad834fc6"} Jun 03 19:30:08.449893 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.449876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:08.450002 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.449940 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:08.450002 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.449989 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:08.450107 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.450055 2578 scope.go:117] "RemoveContainer" containerID="3e2b0f238b17e3a94ab3f3ccbaf24ecccfc5ae2e76adda6ccd4ca92ba3a847ed" Jun 03 19:30:08.466044 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.466018 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:08.466354 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:08.466333 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:09.454546 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:09.454457 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="f07167f439762790de5f3c40c1fd91eb6c28938be1bcef732896c109d1d64657" exitCode=0 Jun 03 19:30:09.454953 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:09.454549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"f07167f439762790de5f3c40c1fd91eb6c28938be1bcef732896c109d1d64657"} Jun 03 19:30:09.458516 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:09.458494 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:30:09.458961 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:09.458923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" event={"ID":"400593bd-b9ff-480b-97a7-7df42e3ed59e","Type":"ContainerStarted","Data":"a89803e8444b700e49bf86ac7963f6097843af62e73a99f0f921fbe3e4eab1a4"} Jun 03 19:30:09.513318 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:09.513264 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" podStartSLOduration=9.664720763 podStartE2EDuration="27.513246163s" totalImagesPullingTime="17.8485254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:09.512548024 +0000 UTC m=+27.886665062" watchObservedRunningTime="2026-06-03 19:30:09.513246163 +0000 UTC m=+27.887363204" Jun 03 19:30:10.122669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.122635 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xt6ns"] Jun 03 19:30:10.122813 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.122766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:10.122908 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:10.122889 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:10.125219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.125188 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5q6z5"] Jun 03 19:30:10.125377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.125362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:10.125508 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:10.125476 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:10.125919 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.125896 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sksjb"] Jun 03 19:30:10.126008 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.125995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:10.126117 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:10.126100 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:10.463743 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.463505 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="4e92f322432e35101375d8b2b9e84ce7fb8e42c2735d5daee51046e012b1a2fe" exitCode=0 Jun 03 19:30:10.463743 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:10.463588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"4e92f322432e35101375d8b2b9e84ce7fb8e42c2735d5daee51046e012b1a2fe"} Jun 03 19:30:12.153578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:12.153549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:12.153578 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:12.153571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:12.154076 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:12.153549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:12.154076 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:12.153656 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:12.154076 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:12.153752 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:12.154076 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:12.153853 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:14.150303 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:14.150261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:14.151004 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:14.150261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:14.151004 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:14.150406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xt6ns" podUID="10966712-2deb-4b32-90d8-926d107c2de2" Jun 03 19:30:14.151004 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:14.150261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:14.151004 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:14.150496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5q6z5" podUID="242788d8-911b-4357-9075-440ef2640712" Jun 03 19:30:14.151004 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:14.150609 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sksjb" podUID="f194ab89-508e-4ddb-af2c-d83eaa470455" Jun 03 19:30:15.479070 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.479035 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="de873993f049d098dc6ae5a50f5570ff20b298db58a94ac0cd6795c5c3a951c8" exitCode=0 Jun 03 19:30:15.479549 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.479110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"de873993f049d098dc6ae5a50f5570ff20b298db58a94ac0cd6795c5c3a951c8"} Jun 03 19:30:15.835196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.835162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:15.835196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.835202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:15.835434 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:15.835308 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:15.835434 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:15.835332 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:15.835434 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:15.835400 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret podName:10966712-2deb-4b32-90d8-926d107c2de2 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:47.835380261 +0000 UTC m=+66.209497280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret") pod "global-pull-secret-syncer-xt6ns" (UID: "10966712-2deb-4b32-90d8-926d107c2de2") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:30:15.835434 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:15.835419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs podName:f194ab89-508e-4ddb-af2c-d83eaa470455 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:47.835412591 +0000 UTC m=+66.209529606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs") pod "network-metrics-daemon-sksjb" (UID: "f194ab89-508e-4ddb-af2c-d83eaa470455") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:30:15.939715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.939680 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-28.ec2.internal" event="NodeReady" Jun 03 19:30:15.939907 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.939814 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:30:15.989742 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:15.989708 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vkvq7"] Jun 03 19:30:16.007085 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.007050 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fq27d"] Jun 03 19:30:16.007270 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.007192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.009569 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.009539 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:30:16.009715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.009539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gklzb\"" Jun 03 19:30:16.009715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.009539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:30:16.019347 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.019323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vkvq7"] Jun 03 19:30:16.019463 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.019363 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fq27d"] Jun 03 19:30:16.019463 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.019439 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.023937 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.023908 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:30:16.024079 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.023939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mrws6\"" Jun 03 19:30:16.024079 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.023974 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:30:16.024185 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.023914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:30:16.036688 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.036660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:16.036863 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.036769 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:30:16.036863 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.036783 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:30:16.036863 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.036791 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lq5nv for pod openshift-network-diagnostics/network-check-target-5q6z5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:16.036863 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.036835 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv podName:242788d8-911b-4357-9075-440ef2640712 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:48.036822239 +0000 UTC m=+66.410939253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lq5nv" (UniqueName: "kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv") pod "network-check-target-5q6z5" (UID: "242788d8-911b-4357-9075-440ef2640712") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:30:16.137520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.137520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-tmp-dir\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.137520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sg2\" (UniqueName: \"kubernetes.io/projected/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-kube-api-access-k8sg2\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.137758 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-config-volume\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.137758 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlczp\" (UniqueName: \"kubernetes.io/projected/3960550a-6bfd-46ea-87e9-716901f7eaf0-kube-api-access-vlczp\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.137758 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.137661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3960550a-6bfd-46ea-87e9-716901f7eaf0-cert\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.150663 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.150630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:16.150663 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.150646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:16.150968 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.150944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:16.153623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153604 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvcxn\"" Jun 03 19:30:16.153777 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tx4t\"" Jun 03 19:30:16.153897 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:30:16.153897 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:30:16.153897 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153705 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:30:16.154109 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.153693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:30:16.238221 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-config-volume\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.238221 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlczp\" (UniqueName: \"kubernetes.io/projected/3960550a-6bfd-46ea-87e9-716901f7eaf0-kube-api-access-vlczp\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3960550a-6bfd-46ea-87e9-716901f7eaf0-cert\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-tmp-dir\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sg2\" (UniqueName: \"kubernetes.io/projected/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-kube-api-access-k8sg2\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.238407 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:16.238485 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.238484 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:16.738460872 +0000 UTC m=+35.112577907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:16.238788 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-tmp-dir\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.238898 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.238877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-config-volume\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.242529 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.242497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3960550a-6bfd-46ea-87e9-716901f7eaf0-cert\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.249421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.249394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sg2\" (UniqueName: \"kubernetes.io/projected/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-kube-api-access-k8sg2\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.249592 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.249566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlczp\" (UniqueName: \"kubernetes.io/projected/3960550a-6bfd-46ea-87e9-716901f7eaf0-kube-api-access-vlczp\") pod \"ingress-canary-fq27d\" (UID: \"3960550a-6bfd-46ea-87e9-716901f7eaf0\") " pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.328573 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.328523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fq27d" Jun 03 19:30:16.484941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.484703 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2441219-876b-48a7-9656-6bbe829b05a0" containerID="bffa0c01878a437686e7de7c1dc74ff75226f82529af3f6f02b13b96da555872" exitCode=0 Jun 03 19:30:16.485525 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.484788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerDied","Data":"bffa0c01878a437686e7de7c1dc74ff75226f82529af3f6f02b13b96da555872"} Jun 03 19:30:16.514911 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.514871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fq27d"] Jun 03 19:30:16.519789 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:16.519747 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3960550a_6bfd_46ea_87e9_716901f7eaf0.slice/crio-c615276d709e781875dee3c764a78ba9d1ef6347abb0b1442637dd1c1d372f41 WatchSource:0}: Error finding container c615276d709e781875dee3c764a78ba9d1ef6347abb0b1442637dd1c1d372f41: Status 404 returned error can't find the container with id c615276d709e781875dee3c764a78ba9d1ef6347abb0b1442637dd1c1d372f41 Jun 03 19:30:16.743001 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:16.742912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:16.743177 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.743021 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:16.743177 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:16.743074 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:17.743059554 +0000 UTC m=+36.117176569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:17.488777 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:17.488739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fq27d" event={"ID":"3960550a-6bfd-46ea-87e9-716901f7eaf0","Type":"ContainerStarted","Data":"c615276d709e781875dee3c764a78ba9d1ef6347abb0b1442637dd1c1d372f41"} Jun 03 19:30:17.492962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:17.492930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ftml" event={"ID":"d2441219-876b-48a7-9656-6bbe829b05a0","Type":"ContainerStarted","Data":"5934b0f93ac609874c4ff063af5395015583c8b42ec203a13dba9e3371cca3ac"} Jun 03 19:30:17.515931 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:17.515877 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6ftml" podStartSLOduration=7.586111913 podStartE2EDuration="35.515855188s" totalImagesPullingTime="27.929743275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:17.515695623 +0000 UTC m=+35.889812697" watchObservedRunningTime="2026-06-03 19:30:17.515855188 +0000 UTC m=+35.889972337" Jun 03 19:30:17.752039 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:17.751939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:17.752203 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:17.752080 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:17.752203 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:17.752160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:19.752141638 +0000 UTC m=+38.126258672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:19.498380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:19.498188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fq27d" event={"ID":"3960550a-6bfd-46ea-87e9-716901f7eaf0","Type":"ContainerStarted","Data":"4d041aba49c7f8175f9f2c89fd8ff9f88050daf0803bcbc6a0a72ad9b734e834"} Jun 03 19:30:19.515172 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:19.515123 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fq27d" podStartSLOduration=2.296591077 podStartE2EDuration="4.515106539s" totalImagesPullingTime="2.218515462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:19.514566121 +0000 UTC m=+37.888683171" watchObservedRunningTime="2026-06-03 19:30:19.515106539 +0000 UTC m=+37.889223610" Jun 03 19:30:19.765720 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:19.765629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:19.765939 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:19.765736 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:19.765939 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:19.765786 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:23.765772844 +0000 UTC m=+42.139889859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:20.454984 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.454952 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96"] Jun 03 19:30:20.476044 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.475998 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-ll9k2"] Jun 03 19:30:20.476228 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.476169 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.479969 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.479934 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.480999 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.480973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rsxf7\"" Jun 03 19:30:20.481117 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.480976 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 19:30:20.481117 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.480974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 19:30:20.481117 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.481020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.496438 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.496394 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96"] Jun 03 19:30:20.496438 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.496442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-ll9k2"] Jun 03 19:30:20.496661 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.496543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.506280 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.506241 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d4t7b\"" Jun 03 19:30:20.506792 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.506475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.506792 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.506671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 19:30:20.506792 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.506246 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.506976 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.506961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 19:30:20.511223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.511201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 19:30:20.557268 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.557234 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7"] Jun 03 19:30:20.570774 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.570727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8542a33-b550-4d3f-955d-076aae969be6-serving-cert\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.570954 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.570783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gth8p\" (UniqueName: \"kubernetes.io/projected/b8542a33-b550-4d3f-955d-076aae969be6-kube-api-access-gth8p\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.570954 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.570920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb4e6c95-1710-488e-999e-fe30271a0004-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.571085 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.570986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.571085 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.571058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.571182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.571086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsnd\" (UniqueName: \"kubernetes.io/projected/eb4e6c95-1710-488e-999e-fe30271a0004-kube-api-access-llsnd\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.571182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.571130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-tmp\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.571182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.571169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-snapshots\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.571305 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.571220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-service-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.576579 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.576552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7"] Jun 03 19:30:20.576730 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.576643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" Jun 03 19:30:20.579293 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.579272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.579416 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.579303 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5lcdc\"" Jun 03 19:30:20.579416 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.579272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.660127 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.660070 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-b9qcb"] Jun 03 19:30:20.671771 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.671736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb4e6c95-1710-488e-999e-fe30271a0004-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.671998 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.671973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672104 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.672182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llsnd\" (UniqueName: \"kubernetes.io/projected/eb4e6c95-1710-488e-999e-fe30271a0004-kube-api-access-llsnd\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.672182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29xt2\" (UniqueName: \"kubernetes.io/projected/234e08b5-b60c-4cf9-a97e-ee15d8786895-kube-api-access-29xt2\") pod \"volume-data-source-validator-78dd696465-dsqt7\" (UID: \"234e08b5-b60c-4cf9-a97e-ee15d8786895\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" Jun 03 19:30:20.672285 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.672193 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:20.672285 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-tmp\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672285 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.672249 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:21.17223116 +0000 UTC m=+39.546348175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:20.672458 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-snapshots\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672458 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-service-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672458 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8542a33-b550-4d3f-955d-076aae969be6-serving-cert\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672603 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-tmp\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672603 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gth8p\" (UniqueName: \"kubernetes.io/projected/b8542a33-b550-4d3f-955d-076aae969be6-kube-api-access-gth8p\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672709 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/eb4e6c95-1710-488e-999e-fe30271a0004-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.672893 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b8542a33-b550-4d3f-955d-076aae969be6-snapshots\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672967 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-service-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.672967 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.672905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8542a33-b550-4d3f-955d-076aae969be6-trusted-ca-bundle\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.676528 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.676502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8542a33-b550-4d3f-955d-076aae969be6-serving-cert\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.681075 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.681049 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54c4595d75-nglmb"] Jun 03 19:30:20.681236 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.681216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.684169 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.684147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.684363 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.684245 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 19:30:20.684824 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.684278 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.684824 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.684669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 19:30:20.684824 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.684779 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f72t8\"" Jun 03 19:30:20.688035 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.688011 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsnd\" (UniqueName: \"kubernetes.io/projected/eb4e6c95-1710-488e-999e-fe30271a0004-kube-api-access-llsnd\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:20.689562 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.689546 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 19:30:20.690980 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.690660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gth8p\" (UniqueName: \"kubernetes.io/projected/b8542a33-b550-4d3f-955d-076aae969be6-kube-api-access-gth8p\") pod \"insights-operator-69684796bc-ll9k2\" (UID: \"b8542a33-b550-4d3f-955d-076aae969be6\") " pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.708158 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.708099 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb"] Jun 03 19:30:20.708270 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.708206 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.710600 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.710579 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:30:20.710600 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.710600 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:30:20.710828 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.710812 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:30:20.710917 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.710877 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djr9z\"" Jun 03 19:30:20.723041 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.723011 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:30:20.732393 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.732361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-b9qcb"] Jun 03 19:30:20.732393 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.732395 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb"] Jun 03 19:30:20.732577 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.732415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54c4595d75-nglmb"] Jun 03 19:30:20.732577 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.732494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.734816 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.734787 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 19:30:20.734941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.734796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:30:20.734941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.734903 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vmfsh\"" Jun 03 19:30:20.734941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.734930 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 19:30:20.773675 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.773635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-config\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.773863 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.773768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29xt2\" (UniqueName: \"kubernetes.io/projected/234e08b5-b60c-4cf9-a97e-ee15d8786895-kube-api-access-29xt2\") pod \"volume-data-source-validator-78dd696465-dsqt7\" (UID: \"234e08b5-b60c-4cf9-a97e-ee15d8786895\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" Jun 03 19:30:20.773863 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.773824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-trusted-ca\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.773941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.773874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6xr2\" (UniqueName: \"kubernetes.io/projected/b86dd834-3c3c-48be-98b6-326c0fff3e38-kube-api-access-d6xr2\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.774015 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.773999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b86dd834-3c3c-48be-98b6-326c0fff3e38-serving-cert\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.787814 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.787788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29xt2\" (UniqueName: \"kubernetes.io/projected/234e08b5-b60c-4cf9-a97e-ee15d8786895-kube-api-access-29xt2\") pod \"volume-data-source-validator-78dd696465-dsqt7\" (UID: \"234e08b5-b60c-4cf9-a97e-ee15d8786895\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" Jun 03 19:30:20.813941 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.813906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-ll9k2" Jun 03 19:30:20.874409 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6xr2\" (UniqueName: \"kubernetes.io/projected/b86dd834-3c3c-48be-98b6-326c0fff3e38-kube-api-access-d6xr2\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.874530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sw2l\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874530 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.874736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.874910 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b86dd834-3c3c-48be-98b6-326c0fff3e38-serving-cert\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.875284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.874982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-trusted-ca\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.875284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-config\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.875284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.875284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.875284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbxl5\" (UniqueName: \"kubernetes.io/projected/bba06996-e8fc-4887-805e-862db506b3f1-kube-api-access-rbxl5\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.875735 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-config\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.875814 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.875757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b86dd834-3c3c-48be-98b6-326c0fff3e38-trusted-ca\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.877871 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.877827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b86dd834-3c3c-48be-98b6-326c0fff3e38-serving-cert\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.882622 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.882597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6xr2\" (UniqueName: \"kubernetes.io/projected/b86dd834-3c3c-48be-98b6-326c0fff3e38-kube-api-access-d6xr2\") pod \"console-operator-85bd8fd97d-b9qcb\" (UID: \"b86dd834-3c3c-48be-98b6-326c0fff3e38\") " pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:20.885418 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.885394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" Jun 03 19:30:20.953220 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.953004 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-ll9k2"] Jun 03 19:30:20.957443 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:20.957410 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8542a33_b550_4d3f_955d_076aae969be6.slice/crio-98bcb88ffa79970bf9d46cfae98dfcbc6f0e6ae8173034c837f3381220612486 WatchSource:0}: Error finding container 98bcb88ffa79970bf9d46cfae98dfcbc6f0e6ae8173034c837f3381220612486: Status 404 returned error can't find the container with id 98bcb88ffa79970bf9d46cfae98dfcbc6f0e6ae8173034c837f3381220612486 Jun 03 19:30:20.975937 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.975906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.975973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.975997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbxl5\" (UniqueName: \"kubernetes.io/projected/bba06996-e8fc-4887-805e-862db506b3f1-kube-api-access-rbxl5\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.976115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sw2l\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976380 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.976152 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:20.976380 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.976167 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:20.976380 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.976221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:21.476202929 +0000 UTC m=+39.850319944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:20.976380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.976648 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976648 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.976758 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.976693 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:30:20.976758 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:20.976747 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls podName:bba06996-e8fc-4887-805e-862db506b3f1 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:21.476731153 +0000 UTC m=+39.850848181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-lpmqb" (UID: "bba06996-e8fc-4887-805e-862db506b3f1") : secret "samples-operator-tls" not found Jun 03 19:30:20.976937 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.976768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.977126 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.977105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.977352 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.977328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.979270 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.979242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.979356 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.979282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.984704 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.984677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbxl5\" (UniqueName: \"kubernetes.io/projected/bba06996-e8fc-4887-805e-862db506b3f1-kube-api-access-rbxl5\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:20.985568 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.985541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:20.985741 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:20.985724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sw2l\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:21.002948 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.002918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:21.033330 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.033296 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7"] Jun 03 19:30:21.036766 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:21.036743 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234e08b5_b60c_4cf9_a97e_ee15d8786895.slice/crio-90ba3404936093dab1eee1cc8768e22b809135ca5cf0505b3250a69a31ecc402 WatchSource:0}: Error finding container 90ba3404936093dab1eee1cc8768e22b809135ca5cf0505b3250a69a31ecc402: Status 404 returned error can't find the container with id 90ba3404936093dab1eee1cc8768e22b809135ca5cf0505b3250a69a31ecc402 Jun 03 19:30:21.153701 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.153666 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-b9qcb"] Jun 03 19:30:21.156832 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:21.156807 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86dd834_3c3c_48be_98b6_326c0fff3e38.slice/crio-e552a539b48ee6f2a700c0641e6bb66f53f3c3e0a1b4896753051102d1f5c981 WatchSource:0}: Error finding container e552a539b48ee6f2a700c0641e6bb66f53f3c3e0a1b4896753051102d1f5c981: Status 404 returned error can't find the container with id e552a539b48ee6f2a700c0641e6bb66f53f3c3e0a1b4896753051102d1f5c981 Jun 03 19:30:21.178995 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.178963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:21.179148 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.179113 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:21.179189 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.179177 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.179161136 +0000 UTC m=+40.553278151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:21.481184 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.481143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:21.481184 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.481189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:21.481401 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.481298 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:30:21.481401 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.481303 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:21.481401 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.481325 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:21.481401 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.481358 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls podName:bba06996-e8fc-4887-805e-862db506b3f1 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.4813393 +0000 UTC m=+40.855456317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-lpmqb" (UID: "bba06996-e8fc-4887-805e-862db506b3f1") : secret "samples-operator-tls" not found Jun 03 19:30:21.481401 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:21.481372 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:22.481366041 +0000 UTC m=+40.855483056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:21.513533 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.513497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" event={"ID":"b86dd834-3c3c-48be-98b6-326c0fff3e38","Type":"ContainerStarted","Data":"e552a539b48ee6f2a700c0641e6bb66f53f3c3e0a1b4896753051102d1f5c981"} Jun 03 19:30:21.514700 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.514667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ll9k2" event={"ID":"b8542a33-b550-4d3f-955d-076aae969be6","Type":"ContainerStarted","Data":"98bcb88ffa79970bf9d46cfae98dfcbc6f0e6ae8173034c837f3381220612486"} Jun 03 19:30:21.515585 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:21.515566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" event={"ID":"234e08b5-b60c-4cf9-a97e-ee15d8786895","Type":"ContainerStarted","Data":"90ba3404936093dab1eee1cc8768e22b809135ca5cf0505b3250a69a31ecc402"} Jun 03 19:30:22.187258 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:22.187219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:22.187423 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.187379 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:22.187489 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.187466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:24.18744301 +0000 UTC m=+42.561560029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:22.490619 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:22.490523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:22.490619 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:22.490584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:22.490864 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.490706 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:30:22.490864 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.490765 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls podName:bba06996-e8fc-4887-805e-862db506b3f1 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:24.490746554 +0000 UTC m=+42.864863583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-lpmqb" (UID: "bba06996-e8fc-4887-805e-862db506b3f1") : secret "samples-operator-tls" not found Jun 03 19:30:22.490864 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.490705 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:22.490864 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.490812 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:22.491037 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:22.490886 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:24.490871286 +0000 UTC m=+42.864988302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:23.521780 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:23.521737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" event={"ID":"234e08b5-b60c-4cf9-a97e-ee15d8786895","Type":"ContainerStarted","Data":"700857babf866d3a5d6a9cc4b13b6edd4e0861b2eb18ac0eb08efc9bc1cfccee"} Jun 03 19:30:23.537682 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:23.537631 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-dsqt7" podStartSLOduration=1.719001017 podStartE2EDuration="3.537612209s" totalImagesPullingTime="1.818611192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:23.537201664 +0000 UTC m=+41.911318705" watchObservedRunningTime="2026-06-03 19:30:23.537612209 +0000 UTC m=+41.911729248" Jun 03 19:30:23.803124 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:23.803083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:23.803313 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:23.803238 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:23.803313 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:23.803306 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:31.803285836 +0000 UTC m=+50.177402856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:24.207013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.206922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:24.207164 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.207082 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:24.207164 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.207148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:28.207134163 +0000 UTC m=+46.581251181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:24.510278 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.510222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:24.510482 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.510312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:24.510482 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.510472 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:30:24.510590 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.510541 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls podName:bba06996-e8fc-4887-805e-862db506b3f1 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:28.510522919 +0000 UTC m=+46.884639950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-lpmqb" (UID: "bba06996-e8fc-4887-805e-862db506b3f1") : secret "samples-operator-tls" not found Jun 03 19:30:24.511092 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.511066 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:24.511190 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.511089 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:24.511190 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:24.511151 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:28.511134741 +0000 UTC m=+46.885251756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:24.526556 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.526410 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ll9k2" event={"ID":"b8542a33-b550-4d3f-955d-076aae969be6","Type":"ContainerStarted","Data":"1c21c13f74500f60fc05443041cc883808d914e7119aec60109e25596aebc51a"} Jun 03 19:30:24.528133 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.528110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" event={"ID":"b86dd834-3c3c-48be-98b6-326c0fff3e38","Type":"ContainerStarted","Data":"579301559e40d04c40b1fade2af384b0185d74fa81e3e51a24de3a7fda74f405"} Jun 03 19:30:24.528339 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.528322 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:24.529591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.529566 2578 patch_prober.go:28] interesting pod/console-operator-85bd8fd97d-b9qcb container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 03 19:30:24.529691 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.529620 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podUID="b86dd834-3c3c-48be-98b6-326c0fff3e38" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 03 19:30:24.552099 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.552047 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-ll9k2" podStartSLOduration=1.172342928 podStartE2EDuration="4.552032733s" totalImagesPullingTime="3.379689805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:24.550954165 +0000 UTC m=+42.925071214" watchObservedRunningTime="2026-06-03 19:30:24.552032733 +0000 UTC m=+42.926149788" Jun 03 19:30:24.572896 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:24.572819 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podStartSLOduration=1.3869427 podStartE2EDuration="4.57279367s" totalImagesPullingTime="3.18585097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:24.57220939 +0000 UTC m=+42.946326438" watchObservedRunningTime="2026-06-03 19:30:24.57279367 +0000 UTC m=+42.946910705" Jun 03 19:30:25.532476 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:25.532300 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/0.log" Jun 03 19:30:25.532926 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:25.532487 2578 generic.go:356] "Generic (PLEG): container finished" podID="b86dd834-3c3c-48be-98b6-326c0fff3e38" containerID="579301559e40d04c40b1fade2af384b0185d74fa81e3e51a24de3a7fda74f405" exitCode=255 Jun 03 19:30:25.532926 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:25.532562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" event={"ID":"b86dd834-3c3c-48be-98b6-326c0fff3e38","Type":"ContainerDied","Data":"579301559e40d04c40b1fade2af384b0185d74fa81e3e51a24de3a7fda74f405"} Jun 03 19:30:25.532926 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:25.532789 2578 scope.go:117] "RemoveContainer" containerID="579301559e40d04c40b1fade2af384b0185d74fa81e3e51a24de3a7fda74f405" Jun 03 19:30:26.538092 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:30:26.538546 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/0.log" Jun 03 19:30:26.538611 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538566 2578 generic.go:356] "Generic (PLEG): container finished" podID="b86dd834-3c3c-48be-98b6-326c0fff3e38" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" exitCode=255 Jun 03 19:30:26.538659 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" event={"ID":"b86dd834-3c3c-48be-98b6-326c0fff3e38","Type":"ContainerDied","Data":"63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec"} Jun 03 19:30:26.538715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538669 2578 scope.go:117] "RemoveContainer" containerID="579301559e40d04c40b1fade2af384b0185d74fa81e3e51a24de3a7fda74f405" Jun 03 19:30:26.538979 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:26.538960 2578 scope.go:117] "RemoveContainer" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" Jun 03 19:30:26.539167 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:26.539146 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-b9qcb_openshift-console-operator(b86dd834-3c3c-48be-98b6-326c0fff3e38)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podUID="b86dd834-3c3c-48be-98b6-326c0fff3e38" Jun 03 19:30:27.542266 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:27.542239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:30:27.542736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:27.542587 2578 scope.go:117] "RemoveContainer" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" Jun 03 19:30:27.542776 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:27.542725 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-b9qcb_openshift-console-operator(b86dd834-3c3c-48be-98b6-326c0fff3e38)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podUID="b86dd834-3c3c-48be-98b6-326c0fff3e38" Jun 03 19:30:28.211315 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.211280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bzfs_d2ec455d-8439-467f-aa9a-8e69d52a0d72/dns-node-resolver/0.log" Jun 03 19:30:28.243979 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.243936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:28.244148 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.244105 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:28.244212 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.244194 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:36.244169599 +0000 UTC m=+54.618286630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:28.546488 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.546391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.546531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.546543 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.546600 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls podName:bba06996-e8fc-4887-805e-862db506b3f1 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:36.546582794 +0000 UTC m=+54.920699809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-lpmqb" (UID: "bba06996-e8fc-4887-805e-862db506b3f1") : secret "samples-operator-tls" not found Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.546616 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.546626 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:28.546902 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:28.546673 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:36.546661448 +0000 UTC m=+54.920778463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:28.734042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.734003 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dx9l7"] Jun 03 19:30:28.755782 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.755754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dx9l7"] Jun 03 19:30:28.755948 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.755868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.758592 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.758567 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 19:30:28.759542 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.759518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rxs2p\"" Jun 03 19:30:28.759662 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.759512 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 19:30:28.759662 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.759567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 19:30:28.759662 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.759568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 19:30:28.850059 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.850018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwjl\" (UniqueName: \"kubernetes.io/projected/215a1ed0-5d7c-4e89-a319-a5f000f8590d-kube-api-access-7jwjl\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.850059 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.850070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-cabundle\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.850343 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.850163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-key\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.951161 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.951120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwjl\" (UniqueName: \"kubernetes.io/projected/215a1ed0-5d7c-4e89-a319-a5f000f8590d-kube-api-access-7jwjl\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.951161 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.951164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-cabundle\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.951359 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.951246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-key\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.952087 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.952069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-cabundle\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.955455 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.955429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/215a1ed0-5d7c-4e89-a319-a5f000f8590d-signing-key\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:28.960250 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:28.960221 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwjl\" (UniqueName: \"kubernetes.io/projected/215a1ed0-5d7c-4e89-a319-a5f000f8590d-kube-api-access-7jwjl\") pod \"service-ca-7d74d578b8-dx9l7\" (UID: \"215a1ed0-5d7c-4e89-a319-a5f000f8590d\") " pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:29.065467 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:29.065427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" Jun 03 19:30:29.211283 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:29.211055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-dx9l7"] Jun 03 19:30:29.212284 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:29.212217 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvhqt_5633f6c7-559e-4400-b6c5-feb3bb2c9ee0/node-ca/0.log" Jun 03 19:30:29.215399 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:29.215374 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215a1ed0_5d7c_4e89_a319_a5f000f8590d.slice/crio-40eb87b0e34b5cc6acbecf57e18fa1558b72be9728f8d5b696e5f45177843552 WatchSource:0}: Error finding container 40eb87b0e34b5cc6acbecf57e18fa1558b72be9728f8d5b696e5f45177843552: Status 404 returned error can't find the container with id 40eb87b0e34b5cc6acbecf57e18fa1558b72be9728f8d5b696e5f45177843552 Jun 03 19:30:29.548479 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:29.548370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" event={"ID":"215a1ed0-5d7c-4e89-a319-a5f000f8590d","Type":"ContainerStarted","Data":"40eb87b0e34b5cc6acbecf57e18fa1558b72be9728f8d5b696e5f45177843552"} Jun 03 19:30:30.011631 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:30.011602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fq27d_3960550a-6bfd-46ea-87e9-716901f7eaf0/serve-healthcheck-canary/0.log" Jun 03 19:30:31.003377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:31.003341 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:31.003749 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:31.003707 2578 scope.go:117] "RemoveContainer" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" Jun 03 19:30:31.003894 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:31.003875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-b9qcb_openshift-console-operator(b86dd834-3c3c-48be-98b6-326c0fff3e38)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podUID="b86dd834-3c3c-48be-98b6-326c0fff3e38" Jun 03 19:30:31.878364 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:31.878340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:31.878502 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:31.878474 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:30:31.878555 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:31.878528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls podName:7c8ebfc9-7904-4fc5-86e1-001a88ab55aa nodeName:}" failed. No retries permitted until 2026-06-03 19:30:47.878511855 +0000 UTC m=+66.252628873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls") pod "dns-default-vkvq7" (UID: "7c8ebfc9-7904-4fc5-86e1-001a88ab55aa") : secret "dns-default-metrics-tls" not found Jun 03 19:30:32.558714 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:32.558671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" event={"ID":"215a1ed0-5d7c-4e89-a319-a5f000f8590d","Type":"ContainerStarted","Data":"f49b74b71a8303f5120719f70b7ad979243722959cae69aeb25ad3373fdaefa6"} Jun 03 19:30:32.578306 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:32.578253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-dx9l7" podStartSLOduration=1.9231684530000002 podStartE2EDuration="4.578236703s" totalImagesPullingTime="2.65506825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:32.577406981 +0000 UTC m=+50.951524018" watchObservedRunningTime="2026-06-03 19:30:32.578236703 +0000 UTC m=+50.952353740" Jun 03 19:30:34.528974 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:34.528932 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:34.529495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:34.529338 2578 scope.go:117] "RemoveContainer" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" Jun 03 19:30:34.529495 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:34.529478 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-b9qcb_openshift-console-operator(b86dd834-3c3c-48be-98b6-326c0fff3e38)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" podUID="b86dd834-3c3c-48be-98b6-326c0fff3e38" Jun 03 19:30:36.312790 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.312747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:36.313232 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:36.312925 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:36.313232 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:36.313017 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls podName:eb4e6c95-1710-488e-999e-fe30271a0004 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.312990744 +0000 UTC m=+70.687107762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-g8s96" (UID: "eb4e6c95-1710-488e-999e-fe30271a0004") : secret "cluster-monitoring-operator-tls" not found Jun 03 19:30:36.614622 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.614522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:36.614622 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.614568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:36.614812 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:36.614665 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 19:30:36.614812 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:36.614686 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54c4595d75-nglmb: secret "image-registry-tls" not found Jun 03 19:30:36.614812 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:36.614742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls podName:3ec36b95-0b96-4735-b561-9fd45e43f9db nodeName:}" failed. No retries permitted until 2026-06-03 19:30:52.614727442 +0000 UTC m=+70.988844456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls") pod "image-registry-54c4595d75-nglmb" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db") : secret "image-registry-tls" not found Jun 03 19:30:36.618406 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.618367 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bba06996-e8fc-4887-805e-862db506b3f1-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-lpmqb\" (UID: \"bba06996-e8fc-4887-805e-862db506b3f1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:36.641797 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.641762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" Jun 03 19:30:36.775755 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:36.772803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb"] Jun 03 19:30:37.580110 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:37.580072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" event={"ID":"bba06996-e8fc-4887-805e-862db506b3f1","Type":"ContainerStarted","Data":"1aab459a4523f26f2dcb2ff7d60d367d98f49d868320562d24fd94fa56017419"} Jun 03 19:30:39.588009 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:39.587973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" event={"ID":"bba06996-e8fc-4887-805e-862db506b3f1","Type":"ContainerStarted","Data":"02c54b40ab0ffdc9ab723dee9ea32fb96501ad4cb72ad9c6c77c677619b10bd6"} Jun 03 19:30:39.588392 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:39.588027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" event={"ID":"bba06996-e8fc-4887-805e-862db506b3f1","Type":"ContainerStarted","Data":"d6990e42cdd7c9c31f00975913a893064e254147364b64adb621d9abcaa014ee"} Jun 03 19:30:39.604979 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:39.604931 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-lpmqb" podStartSLOduration=17.281439261 podStartE2EDuration="19.604914497s" totalImagesPullingTime="2.323475236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:39.603531646 +0000 UTC m=+57.977648680" watchObservedRunningTime="2026-06-03 19:30:39.604914497 +0000 UTC m=+57.979031533" Jun 03 19:30:40.475219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:40.475185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-prsnq" Jun 03 19:30:46.150229 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:46.150187 2578 scope.go:117] "RemoveContainer" containerID="63d032518ae4fee0864f591438f73b887712c574d8f27bf0b3862a4c566ecbec" Jun 03 19:30:46.610460 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:46.610430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:30:46.610668 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:46.610488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" event={"ID":"b86dd834-3c3c-48be-98b6-326c0fff3e38","Type":"ContainerStarted","Data":"37413e5be03fe54302005bb0191d8d762e770deb4218caf11ad3d397c24735db"} Jun 03 19:30:46.610830 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:46.610810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:46.851561 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:46.851531 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-b9qcb" Jun 03 19:30:47.912023 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.911956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:47.912443 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.912052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:47.912443 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.912102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:47.914340 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.914317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c8ebfc9-7904-4fc5-86e1-001a88ab55aa-metrics-tls\") pod \"dns-default-vkvq7\" (UID: \"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa\") " pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:47.914689 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.914670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:30:47.915591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.915572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:30:47.924565 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.924538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f194ab89-508e-4ddb-af2c-d83eaa470455-metrics-certs\") pod \"network-metrics-daemon-sksjb\" (UID: \"f194ab89-508e-4ddb-af2c-d83eaa470455\") " pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:47.924673 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.924605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10966712-2deb-4b32-90d8-926d107c2de2-original-pull-secret\") pod \"global-pull-secret-syncer-xt6ns\" (UID: \"10966712-2deb-4b32-90d8-926d107c2de2\") " pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:47.966913 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.966871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xt6ns" Jun 03 19:30:47.973965 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.973939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4tx4t\"" Jun 03 19:30:47.981953 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:47.981902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sksjb" Jun 03 19:30:48.100636 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.100603 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xt6ns"] Jun 03 19:30:48.103733 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:48.103698 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10966712_2deb_4b32_90d8_926d107c2de2.slice/crio-9eac2b2d004283241a9125294d9995af48d8794e380663186625c650be15d16f WatchSource:0}: Error finding container 9eac2b2d004283241a9125294d9995af48d8794e380663186625c650be15d16f: Status 404 returned error can't find the container with id 9eac2b2d004283241a9125294d9995af48d8794e380663186625c650be15d16f Jun 03 19:30:48.114026 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.113998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:48.116192 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.116173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:30:48.119154 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.119134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gklzb\"" Jun 03 19:30:48.124020 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.123979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sksjb"] Jun 03 19:30:48.126864 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.126828 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:30:48.127558 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.127540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:48.127819 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:48.127794 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf194ab89_508e_4ddb_af2c_d83eaa470455.slice/crio-f4838327867bf13e6456768f6618777569d3ada8541c3f24ad8873acfa914fd6 WatchSource:0}: Error finding container f4838327867bf13e6456768f6618777569d3ada8541c3f24ad8873acfa914fd6: Status 404 returned error can't find the container with id f4838327867bf13e6456768f6618777569d3ada8541c3f24ad8873acfa914fd6 Jun 03 19:30:48.137183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.137164 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5nv\" (UniqueName: \"kubernetes.io/projected/242788d8-911b-4357-9075-440ef2640712-kube-api-access-lq5nv\") pod \"network-check-target-5q6z5\" (UID: \"242788d8-911b-4357-9075-440ef2640712\") " pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:48.257214 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.257183 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vkvq7"] Jun 03 19:30:48.259785 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:48.259758 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8ebfc9_7904_4fc5_86e1_001a88ab55aa.slice/crio-94494ced1f35f8ec0e8bae999c5c0ea2fe2615c21005019ae00bd9327d6358b9 WatchSource:0}: Error finding container 94494ced1f35f8ec0e8bae999c5c0ea2fe2615c21005019ae00bd9327d6358b9: Status 404 returned error can't find the container with id 94494ced1f35f8ec0e8bae999c5c0ea2fe2615c21005019ae00bd9327d6358b9 Jun 03 19:30:48.263052 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.263033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvcxn\"" Jun 03 19:30:48.271271 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.271250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:48.400088 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.400055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5q6z5"] Jun 03 19:30:48.403462 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:48.403430 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242788d8_911b_4357_9075_440ef2640712.slice/crio-6326e43cdfb19f89b6c1b49c4e9f7da1a46b11bfc2d8dfc18ff369edc0836713 WatchSource:0}: Error finding container 6326e43cdfb19f89b6c1b49c4e9f7da1a46b11bfc2d8dfc18ff369edc0836713: Status 404 returned error can't find the container with id 6326e43cdfb19f89b6c1b49c4e9f7da1a46b11bfc2d8dfc18ff369edc0836713 Jun 03 19:30:48.620113 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.620075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sksjb" event={"ID":"f194ab89-508e-4ddb-af2c-d83eaa470455","Type":"ContainerStarted","Data":"f4838327867bf13e6456768f6618777569d3ada8541c3f24ad8873acfa914fd6"} Jun 03 19:30:48.621489 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.621456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xt6ns" event={"ID":"10966712-2deb-4b32-90d8-926d107c2de2","Type":"ContainerStarted","Data":"9eac2b2d004283241a9125294d9995af48d8794e380663186625c650be15d16f"} Jun 03 19:30:48.622796 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.622773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vkvq7" event={"ID":"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa","Type":"ContainerStarted","Data":"94494ced1f35f8ec0e8bae999c5c0ea2fe2615c21005019ae00bd9327d6358b9"} Jun 03 19:30:48.624036 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:48.624013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5q6z5" event={"ID":"242788d8-911b-4357-9075-440ef2640712","Type":"ContainerStarted","Data":"6326e43cdfb19f89b6c1b49c4e9f7da1a46b11bfc2d8dfc18ff369edc0836713"} Jun 03 19:30:49.634042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:49.633254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sksjb" event={"ID":"f194ab89-508e-4ddb-af2c-d83eaa470455","Type":"ContainerStarted","Data":"4f4a8adcc15d2552ede46c7aaf8f34b8768a0a5b6af6bc36c4217e08701ef25a"} Jun 03 19:30:49.634042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:49.633318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sksjb" event={"ID":"f194ab89-508e-4ddb-af2c-d83eaa470455","Type":"ContainerStarted","Data":"13cb31d8b10c229fb095d358a168f115d9c22ae849c0b2c0ee1a126b328d47aa"} Jun 03 19:30:49.652769 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:49.651585 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sksjb" podStartSLOduration=66.557928629 podStartE2EDuration="1m7.651564044s" totalImagesPullingTime="1.093635415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:49.650801612 +0000 UTC m=+68.024918649" watchObservedRunningTime="2026-06-03 19:30:49.651564044 +0000 UTC m=+68.025681082" Jun 03 19:30:51.642465 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:51.642425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vkvq7" event={"ID":"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa","Type":"ContainerStarted","Data":"ed31d3a73972d637848cc58cc93aeb7f19f2b89fe3e899713bc73b715f6ea819"} Jun 03 19:30:52.259419 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.259384 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s"] Jun 03 19:30:52.262820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.262782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.262992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.262920 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt"] Jun 03 19:30:52.266224 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.266196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.268540 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.268518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:30:52.269576 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.269534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:30:52.270223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.269914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 19:30:52.270223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.269942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sgc64\"" Jun 03 19:30:52.270223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.269959 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:30:52.270223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.270017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 19:30:52.276564 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.276504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s"] Jun 03 19:30:52.280621 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.280599 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt"] Jun 03 19:30:52.296180 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.296146 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c4595d75-nglmb"] Jun 03 19:30:52.296416 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:30:52.296393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54c4595d75-nglmb" podUID="3ec36b95-0b96-4735-b561-9fd45e43f9db" Jun 03 19:30:52.352723 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.352680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f4g\" (UniqueName: \"kubernetes.io/projected/286c62c2-aabc-4c0f-abee-4657da2f01d0-kube-api-access-58f4g\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.352947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.352739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/286c62c2-aabc-4c0f-abee-4657da2f01d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.352947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.352779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:52.352947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.352881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.352947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.352936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzrsm\" (UniqueName: \"kubernetes.io/projected/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-kube-api-access-dzrsm\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.353174 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.353006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-tmp\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.355687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.355646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb4e6c95-1710-488e-999e-fe30271a0004-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-g8s96\" (UID: \"eb4e6c95-1710-488e-999e-fe30271a0004\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:52.362165 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.362086 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-868f87d7c6-hnltl"] Jun 03 19:30:52.365679 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.365648 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-c9w8j"] Jun 03 19:30:52.365836 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.365792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.368611 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.368582 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-qd6fh"] Jun 03 19:30:52.368748 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.368727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.371568 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.371527 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 19:30:52.371694 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.371651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:30:52.371988 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.371961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 19:30:52.372440 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.372423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jvh6f\"" Jun 03 19:30:52.375223 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.375208 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 19:30:52.375442 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.375414 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 19:30:52.375559 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.375454 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lcfsf\"" Jun 03 19:30:52.379685 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.379649 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-c9w8j"] Jun 03 19:30:52.382959 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.382897 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-qd6fh"] Jun 03 19:30:52.391381 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.391350 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zlf7z"] Jun 03 19:30:52.396185 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.396144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.396811 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.396698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868f87d7c6-hnltl"] Jun 03 19:30:52.399249 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.399228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:30:52.399406 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.399384 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:30:52.399512 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.399471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9gpp5\"" Jun 03 19:30:52.414079 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.414047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zlf7z"] Jun 03 19:30:52.453927 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.453891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f4g\" (UniqueName: \"kubernetes.io/projected/286c62c2-aabc-4c0f-abee-4657da2f01d0-kube-api-access-58f4g\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.454119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.453934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/812d9d85-dade-470f-b988-3f6c142b9cda-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.454119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.453965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-image-registry-private-configuration\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-tls\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfa484c-07fb-4f31-a225-0784672e8b0a-data-volume\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/286c62c2-aabc-4c0f-abee-4657da2f01d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-certificates\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-bound-sa-token\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-installation-pull-secrets\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.454342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/812d9d85-dade-470f-b988-3f6c142b9cda-nginx-conf\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8pj\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-kube-api-access-6q8pj\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-trusted-ca\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bfa484c-07fb-4f31-a225-0784672e8b0a-crio-socket\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzrsm\" (UniqueName: \"kubernetes.io/projected/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-kube-api-access-dzrsm\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4v6w\" (UniqueName: \"kubernetes.io/projected/d4603db2-ed97-4049-a58e-12bafd485921-kube-api-access-g4v6w\") pod \"downloads-56b467f5ff-qd6fh\" (UID: \"d4603db2-ed97-4049-a58e-12bafd485921\") " pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f425815-bf63-410a-8f57-1c62c3f6710c-ca-trust-extracted\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-tmp\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tkk5\" (UniqueName: \"kubernetes.io/projected/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-api-access-6tkk5\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.454744 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.454735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bfa484c-07fb-4f31-a225-0784672e8b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.455201 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.455040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-tmp\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.457099 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.457076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.457213 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.457154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/286c62c2-aabc-4c0f-abee-4657da2f01d0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.473061 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.472997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzrsm\" (UniqueName: \"kubernetes.io/projected/006e6cbc-e2d1-4fe7-9da3-9bce983f680b-kube-api-access-dzrsm\") pod \"klusterlet-addon-workmgr-fc6c8d5d6-wlt6s\" (UID: \"006e6cbc-e2d1-4fe7-9da3-9bce983f680b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.473259 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.473237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f4g\" (UniqueName: \"kubernetes.io/projected/286c62c2-aabc-4c0f-abee-4657da2f01d0-kube-api-access-58f4g\") pod \"managed-serviceaccount-addon-agent-7595c768d-pgpbt\" (UID: \"286c62c2-aabc-4c0f-abee-4657da2f01d0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.555731 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.555681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.555731 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.555729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/812d9d85-dade-470f-b988-3f6c142b9cda-nginx-conf\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.556012 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.555752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8pj\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-kube-api-access-6q8pj\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556012 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.555983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-trusted-ca\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bfa484c-07fb-4f31-a225-0784672e8b0a-crio-socket\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.556128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4v6w\" (UniqueName: \"kubernetes.io/projected/d4603db2-ed97-4049-a58e-12bafd485921-kube-api-access-g4v6w\") pod \"downloads-56b467f5ff-qd6fh\" (UID: \"d4603db2-ed97-4049-a58e-12bafd485921\") " pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:30:52.556228 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f425815-bf63-410a-8f57-1c62c3f6710c-ca-trust-extracted\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556228 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tkk5\" (UniqueName: \"kubernetes.io/projected/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-api-access-6tkk5\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.556332 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bfa484c-07fb-4f31-a225-0784672e8b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.556332 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/812d9d85-dade-470f-b988-3f6c142b9cda-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.556332 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-image-registry-private-configuration\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556484 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-tls\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556484 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfa484c-07fb-4f31-a225-0784672e8b0a-data-volume\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.556484 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-certificates\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556484 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.556669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/812d9d85-dade-470f-b988-3f6c142b9cda-nginx-conf\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.556669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-bound-sa-token\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.556669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.556610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-installation-pull-secrets\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.557127 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.557104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bfa484c-07fb-4f31-a225-0784672e8b0a-crio-socket\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.557235 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.557105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bfa484c-07fb-4f31-a225-0784672e8b0a-data-volume\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.558060 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.557523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1f425815-bf63-410a-8f57-1c62c3f6710c-ca-trust-extracted\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.558060 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.557769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-trusted-ca\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.558060 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.558020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-certificates\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.559670 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.559639 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bfa484c-07fb-4f31-a225-0784672e8b0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.559864 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.559819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-registry-tls\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.559982 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.559927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-image-registry-private-configuration\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.560053 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.559977 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/812d9d85-dade-470f-b988-3f6c142b9cda-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-c9w8j\" (UID: \"812d9d85-dade-470f-b988-3f6c142b9cda\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.560922 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.560898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1f425815-bf63-410a-8f57-1c62c3f6710c-installation-pull-secrets\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.564200 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.564173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8pj\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-kube-api-access-6q8pj\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.574574 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.574507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f425815-bf63-410a-8f57-1c62c3f6710c-bound-sa-token\") pod \"image-registry-868f87d7c6-hnltl\" (UID: \"1f425815-bf63-410a-8f57-1c62c3f6710c\") " pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.574574 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.574521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tkk5\" (UniqueName: \"kubernetes.io/projected/9bfa484c-07fb-4f31-a225-0784672e8b0a-kube-api-access-6tkk5\") pod \"insights-runtime-extractor-zlf7z\" (UID: \"9bfa484c-07fb-4f31-a225-0784672e8b0a\") " pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.574574 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.574551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4v6w\" (UniqueName: \"kubernetes.io/projected/d4603db2-ed97-4049-a58e-12bafd485921-kube-api-access-g4v6w\") pod \"downloads-56b467f5ff-qd6fh\" (UID: \"d4603db2-ed97-4049-a58e-12bafd485921\") " pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:30:52.578370 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.578336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:30:52.592001 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.591973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" Jun 03 19:30:52.600648 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.600616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rsxf7\"" Jun 03 19:30:52.608617 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.608575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" Jun 03 19:30:52.646590 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.646554 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:52.654638 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.654611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:52.657251 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.657219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:52.660321 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.660292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"image-registry-54c4595d75-nglmb\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:52.681836 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.681804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-djr9z\"" Jun 03 19:30:52.689190 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.689153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:52.692192 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.692160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" Jun 03 19:30:52.702110 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.702074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:30:52.708991 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.708963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zlf7z" Jun 03 19:30:52.757569 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757530 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757569 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757585 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sw2l\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757626 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757645 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757663 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757682 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757713 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.757820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.757744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted\") pod \"3ec36b95-0b96-4735-b561-9fd45e43f9db\" (UID: \"3ec36b95-0b96-4735-b561-9fd45e43f9db\") " Jun 03 19:30:52.758310 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.758253 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:30:52.758551 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.758525 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:30:52.758874 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.758830 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:30:52.760338 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.760310 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:30:52.760460 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.760417 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:30:52.760460 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.760437 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:30:52.760813 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.760789 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l" (OuterVolumeSpecName: "kube-api-access-6sw2l") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "kube-api-access-6sw2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:30:52.761039 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.761012 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3ec36b95-0b96-4735-b561-9fd45e43f9db" (UID: "3ec36b95-0b96-4735-b561-9fd45e43f9db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859349 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-installation-pull-secrets\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859380 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sw2l\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-kube-api-access-6sw2l\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859390 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-certificates\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859407 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-registry-tls\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859420 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ec36b95-0b96-4735-b561-9fd45e43f9db-bound-sa-token\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859434 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ec36b95-0b96-4735-b561-9fd45e43f9db-image-registry-private-configuration\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859447 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec36b95-0b96-4735-b561-9fd45e43f9db-trusted-ca\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:52.859829 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:52.859456 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ec36b95-0b96-4735-b561-9fd45e43f9db-ca-trust-extracted\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:30:53.639205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.638931 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-c9w8j"] Jun 03 19:30:53.641296 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.641258 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812d9d85_dade_470f_b988_3f6c142b9cda.slice/crio-b9cfd49460b7c52cd2b9310aa255fb4936851718c4b8bf1a8bf996fc4447047d WatchSource:0}: Error finding container b9cfd49460b7c52cd2b9310aa255fb4936851718c4b8bf1a8bf996fc4447047d: Status 404 returned error can't find the container with id b9cfd49460b7c52cd2b9310aa255fb4936851718c4b8bf1a8bf996fc4447047d Jun 03 19:30:53.654803 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.653739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xt6ns" event={"ID":"10966712-2deb-4b32-90d8-926d107c2de2","Type":"ContainerStarted","Data":"ecaf6e12e1e6e039f4d2ff90d512492e2b057857f7d58f2a8183504ba9d780a8"} Jun 03 19:30:53.659404 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.658811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vkvq7" event={"ID":"7c8ebfc9-7904-4fc5-86e1-001a88ab55aa","Type":"ContainerStarted","Data":"9cfcbecb7ecbc12b30797c256c555663c1676e783ac5a6b7b0e3caf452b76f33"} Jun 03 19:30:53.659404 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.659248 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vkvq7" Jun 03 19:30:53.661511 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.661454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5q6z5" event={"ID":"242788d8-911b-4357-9075-440ef2640712","Type":"ContainerStarted","Data":"7af61237ad18cefffe7dbec2d12528058c047ff28451bcd012561a05eb6c5751"} Jun 03 19:30:53.661809 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.661768 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:30:53.662923 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.662904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54c4595d75-nglmb" Jun 03 19:30:53.663334 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.663290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" event={"ID":"812d9d85-dade-470f-b988-3f6c142b9cda","Type":"ContainerStarted","Data":"b9cfd49460b7c52cd2b9310aa255fb4936851718c4b8bf1a8bf996fc4447047d"} Jun 03 19:30:53.673322 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.671076 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xt6ns" podStartSLOduration=66.434765688 podStartE2EDuration="1m11.671056789s" totalImagesPullingTime="5.236291101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.670568228 +0000 UTC m=+72.044685267" watchObservedRunningTime="2026-06-03 19:30:53.671056789 +0000 UTC m=+72.045173831" Jun 03 19:30:53.695790 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.695728 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vkvq7" podStartSLOduration=36.24613253 podStartE2EDuration="38.695704274s" totalImagesPullingTime="2.449571744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.694726184 +0000 UTC m=+72.068843233" watchObservedRunningTime="2026-06-03 19:30:53.695704274 +0000 UTC m=+72.069821312" Jun 03 19:30:53.712641 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.712607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s"] Jun 03 19:30:53.715174 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.715146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868f87d7c6-hnltl"] Jun 03 19:30:53.716583 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.716542 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006e6cbc_e2d1_4fe7_9da3_9bce983f680b.slice/crio-348135b9e5c5e450dfaea64dcedb02cc64936a4d5411ff6923d57eb0ed6484bd WatchSource:0}: Error finding container 348135b9e5c5e450dfaea64dcedb02cc64936a4d5411ff6923d57eb0ed6484bd: Status 404 returned error can't find the container with id 348135b9e5c5e450dfaea64dcedb02cc64936a4d5411ff6923d57eb0ed6484bd Jun 03 19:30:53.717368 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.717344 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f425815_bf63_410a_8f57_1c62c3f6710c.slice/crio-66485ef91cbf62ae24b1ea8060158f93a1d56f884af17aa66757591bef29eb53 WatchSource:0}: Error finding container 66485ef91cbf62ae24b1ea8060158f93a1d56f884af17aa66757591bef29eb53: Status 404 returned error can't find the container with id 66485ef91cbf62ae24b1ea8060158f93a1d56f884af17aa66757591bef29eb53 Jun 03 19:30:53.718944 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.718827 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5q6z5" podStartSLOduration=66.794421878 podStartE2EDuration="1m11.718810262s" totalImagesPullingTime="4.924388384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.718413547 +0000 UTC m=+72.092530607" watchObservedRunningTime="2026-06-03 19:30:53.718810262 +0000 UTC m=+72.092927298" Jun 03 19:30:53.753581 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.753463 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54c4595d75-nglmb"] Jun 03 19:30:53.760798 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.760767 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54c4595d75-nglmb"] Jun 03 19:30:53.784991 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.784964 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96"] Jun 03 19:30:53.787144 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.787112 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4e6c95_1710_488e_999e_fe30271a0004.slice/crio-944dd15bd094277e757158796e35bece1b798875bdec89ed600cbf2d54a2cbff WatchSource:0}: Error finding container 944dd15bd094277e757158796e35bece1b798875bdec89ed600cbf2d54a2cbff: Status 404 returned error can't find the container with id 944dd15bd094277e757158796e35bece1b798875bdec89ed600cbf2d54a2cbff Jun 03 19:30:53.863107 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.863084 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-qd6fh"] Jun 03 19:30:53.866150 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.866020 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4603db2_ed97_4049_a58e_12bafd485921.slice/crio-7352acb9027a752ccdf94d20827b39a14c65cf1a6fb3c63aa09a42fe87fd0a45 WatchSource:0}: Error finding container 7352acb9027a752ccdf94d20827b39a14c65cf1a6fb3c63aa09a42fe87fd0a45: Status 404 returned error can't find the container with id 7352acb9027a752ccdf94d20827b39a14c65cf1a6fb3c63aa09a42fe87fd0a45 Jun 03 19:30:53.867253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.867232 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zlf7z"] Jun 03 19:30:53.870005 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:53.869979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt"] Jun 03 19:30:53.872889 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:30:53.872863 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod286c62c2_aabc_4c0f_abee_4657da2f01d0.slice/crio-31ad2a4a6a861a5b419730d5304baa9b704d20d95185d60e4d30a573c381cf0e WatchSource:0}: Error finding container 31ad2a4a6a861a5b419730d5304baa9b704d20d95185d60e4d30a573c381cf0e: Status 404 returned error can't find the container with id 31ad2a4a6a861a5b419730d5304baa9b704d20d95185d60e4d30a573c381cf0e Jun 03 19:30:54.155917 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.155880 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec36b95-0b96-4735-b561-9fd45e43f9db" path="/var/lib/kubelet/pods/3ec36b95-0b96-4735-b561-9fd45e43f9db/volumes" Jun 03 19:30:54.670520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.670443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-qd6fh" event={"ID":"d4603db2-ed97-4049-a58e-12bafd485921","Type":"ContainerStarted","Data":"7352acb9027a752ccdf94d20827b39a14c65cf1a6fb3c63aa09a42fe87fd0a45"} Jun 03 19:30:54.672250 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.672178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" event={"ID":"006e6cbc-e2d1-4fe7-9da3-9bce983f680b","Type":"ContainerStarted","Data":"348135b9e5c5e450dfaea64dcedb02cc64936a4d5411ff6923d57eb0ed6484bd"} Jun 03 19:30:54.674129 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.674023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" event={"ID":"eb4e6c95-1710-488e-999e-fe30271a0004","Type":"ContainerStarted","Data":"944dd15bd094277e757158796e35bece1b798875bdec89ed600cbf2d54a2cbff"} Jun 03 19:30:54.676001 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.675977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" event={"ID":"286c62c2-aabc-4c0f-abee-4657da2f01d0","Type":"ContainerStarted","Data":"31ad2a4a6a861a5b419730d5304baa9b704d20d95185d60e4d30a573c381cf0e"} Jun 03 19:30:54.681017 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.680983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zlf7z" event={"ID":"9bfa484c-07fb-4f31-a225-0784672e8b0a","Type":"ContainerStarted","Data":"81872256c51054a3f8979cde52fa64e93e3ea01b4630167a099e17355cec2797"} Jun 03 19:30:54.681158 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.681048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zlf7z" event={"ID":"9bfa484c-07fb-4f31-a225-0784672e8b0a","Type":"ContainerStarted","Data":"6e465744182e0ffecbc90c6ddafe346cb3055ce610805eea99de793865e450c5"} Jun 03 19:30:54.685112 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.685081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" event={"ID":"1f425815-bf63-410a-8f57-1c62c3f6710c","Type":"ContainerStarted","Data":"cd5492d23b73b41b34934fc4448b1cb2a4c1de9872eed547301ab7e17635699d"} Jun 03 19:30:54.685251 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.685131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" event={"ID":"1f425815-bf63-410a-8f57-1c62c3f6710c","Type":"ContainerStarted","Data":"66485ef91cbf62ae24b1ea8060158f93a1d56f884af17aa66757591bef29eb53"} Jun 03 19:30:54.707451 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:54.707384 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" podStartSLOduration=2.707359229 podStartE2EDuration="2.707359229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:54.705515809 +0000 UTC m=+73.079632847" watchObservedRunningTime="2026-06-03 19:30:54.707359229 +0000 UTC m=+73.081476251" Jun 03 19:30:55.696560 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.695635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" event={"ID":"812d9d85-dade-470f-b988-3f6c142b9cda","Type":"ContainerStarted","Data":"e6ea118a73fcf72e57c09eb0ebd618eeb9310a632a2c74520d4f74498724a5cb"} Jun 03 19:30:55.700879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.699940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zlf7z" event={"ID":"9bfa484c-07fb-4f31-a225-0784672e8b0a","Type":"ContainerStarted","Data":"548283b286732896b32178e7cd4c27e46cb1efd395feeea05a38dc3c48934eda"} Jun 03 19:30:55.700879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.700616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:30:55.764955 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.762811 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-c9w8j" podStartSLOduration=1.88583513 podStartE2EDuration="3.762787333s" totalImagesPullingTime="1.876952203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:55.71399605 +0000 UTC m=+74.088113089" watchObservedRunningTime="2026-06-03 19:30:55.762787333 +0000 UTC m=+74.136904371" Jun 03 19:30:55.764955 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.764549 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:30:55.767595 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.767570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.773277 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.773252 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 19:30:55.773786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.773423 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 19:30:55.773786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.773653 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 19:30:55.773786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.773688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 19:30:55.774030 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.773900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mmd7x\"" Jun 03 19:30:55.775981 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.774133 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 19:30:55.782761 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.782676 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.886891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.886953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.887039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrh2p\" (UniqueName: \"kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.887089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.887121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.887377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.887167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.988287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrh2p\" (UniqueName: \"kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.989879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.989745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.991343 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.991195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.992186 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.992138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:55.994758 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:55.994722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:56.000205 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:56.000176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:56.006742 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:56.006647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrh2p\" (UniqueName: \"kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p\") pod \"console-689d999966-z6zqj\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:30:56.084394 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:30:56.084350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:00.688421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:00.688381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vkvq7" Jun 03 19:31:01.209123 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.208977 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:31:01.217173 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:31:01.217138 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d691e9_04f5_4c74_ac65_8b90c821306c.slice/crio-575c8f4c600179e1dbae33cf2461279b1fd860f80ce936d9ccc5e5877c99aaf8 WatchSource:0}: Error finding container 575c8f4c600179e1dbae33cf2461279b1fd860f80ce936d9ccc5e5877c99aaf8: Status 404 returned error can't find the container with id 575c8f4c600179e1dbae33cf2461279b1fd860f80ce936d9ccc5e5877c99aaf8 Jun 03 19:31:01.735821 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.735769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" event={"ID":"eb4e6c95-1710-488e-999e-fe30271a0004","Type":"ContainerStarted","Data":"683b877bc2fbc59a444ac3ba84286b1bfc9e2f83280589a4f6f3d14040a66c1f"} Jun 03 19:31:01.738509 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.738473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" event={"ID":"006e6cbc-e2d1-4fe7-9da3-9bce983f680b","Type":"ContainerStarted","Data":"9df2d3d38d0e9af12e86cc4fb5b4cb044b952e760fa405c48705c32fb6203af4"} Jun 03 19:31:01.738791 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.738750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:31:01.740822 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.740795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" event={"ID":"286c62c2-aabc-4c0f-abee-4657da2f01d0","Type":"ContainerStarted","Data":"6e9d525c767da97c3f018e97e29bfd135756e4159cf9e8b12e734c8276bd483d"} Jun 03 19:31:01.740966 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.740885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" Jun 03 19:31:01.743734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.743707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zlf7z" event={"ID":"9bfa484c-07fb-4f31-a225-0784672e8b0a","Type":"ContainerStarted","Data":"ae665625c2c1e4526c8420d42912d5a47bb3f30741b961467665bc5b6fd0a014"} Jun 03 19:31:01.745257 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.745228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689d999966-z6zqj" event={"ID":"b5d691e9-04f5-4c74-ac65-8b90c821306c","Type":"ContainerStarted","Data":"575c8f4c600179e1dbae33cf2461279b1fd860f80ce936d9ccc5e5877c99aaf8"} Jun 03 19:31:01.753936 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.753884 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-g8s96" podStartSLOduration=34.504532085 podStartE2EDuration="41.753863381s" totalImagesPullingTime="7.249331296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:01.753734784 +0000 UTC m=+80.127851833" watchObservedRunningTime="2026-06-03 19:31:01.753863381 +0000 UTC m=+80.127980419" Jun 03 19:31:01.780521 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.780454 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zlf7z" podStartSLOduration=2.794852187 podStartE2EDuration="9.780432561s" totalImagesPullingTime="6.985580374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:01.779377327 +0000 UTC m=+80.153494365" watchObservedRunningTime="2026-06-03 19:31:01.780432561 +0000 UTC m=+80.154549602" Jun 03 19:31:01.795086 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.795019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7595c768d-pgpbt" podStartSLOduration=2.62998922 podStartE2EDuration="9.795000797s" totalImagesPullingTime="7.165011577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:01.794145238 +0000 UTC m=+80.168262276" watchObservedRunningTime="2026-06-03 19:31:01.795000797 +0000 UTC m=+80.169117834" Jun 03 19:31:01.813388 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:01.813314 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc6c8d5d6-wlt6s" podStartSLOduration=2.492469458 podStartE2EDuration="9.813291116s" totalImagesPullingTime="7.320821658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:01.812600116 +0000 UTC m=+80.186717153" watchObservedRunningTime="2026-06-03 19:31:01.813291116 +0000 UTC m=+80.187408154" Jun 03 19:31:05.768479 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:05.768439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689d999966-z6zqj" event={"ID":"b5d691e9-04f5-4c74-ac65-8b90c821306c","Type":"ContainerStarted","Data":"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee"} Jun 03 19:31:05.787089 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:05.787031 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689d999966-z6zqj" podStartSLOduration=7.125204848 podStartE2EDuration="10.787009919s" totalImagesPullingTime="3.661805071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:05.785505459 +0000 UTC m=+84.159622496" watchObservedRunningTime="2026-06-03 19:31:05.787009919 +0000 UTC m=+84.161126957" Jun 03 19:31:06.085537 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:06.085497 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:06.085727 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:06.085572 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:06.092645 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:06.092607 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:06.778295 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:06.778263 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:11.254039 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.253465 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ms48c"] Jun 03 19:31:11.268937 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.268769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.275858 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.274509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:31:11.275858 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.275145 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:31:11.275858 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.275271 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:31:11.282265 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.276567 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-97z8f\"" Jun 03 19:31:11.282265 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.277326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:31:11.427038 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.426912 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:31:11.427656 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-textfile\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.427794 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-tls\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.427794 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-wtmp\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.427794 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.427794 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-metrics-client-ca\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.428042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.428042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b766j\" (UniqueName: \"kubernetes.io/projected/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-kube-api-access-b766j\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.428042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-sys\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.428042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.427992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-root\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b766j\" (UniqueName: \"kubernetes.io/projected/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-kube-api-access-b766j\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-sys\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-root\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-textfile\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-tls\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-wtmp\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-metrics-client-ca\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.529980 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.529953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-metrics-client-ca\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.530119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.530010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-textfile\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.530411 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.530378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-sys\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.530411 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.530397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-wtmp\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.530552 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.530431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-root\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.530714 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.530665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.532645 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.532619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-tls\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.534253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.534217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.539087 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.539064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b766j\" (UniqueName: \"kubernetes.io/projected/e68b5669-cd1b-44e3-8be9-a9c8bd1ade27-kube-api-access-b766j\") pod \"node-exporter-ms48c\" (UID: \"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27\") " pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:11.592395 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:11.592354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ms48c" Jun 03 19:31:15.513633 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:31:15.513591 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68b5669_cd1b_44e3_8be9_a9c8bd1ade27.slice/crio-102792a2730405935c0b223f6ad9ffe9a5178cd1d6f676a43aa98312fe1343b0 WatchSource:0}: Error finding container 102792a2730405935c0b223f6ad9ffe9a5178cd1d6f676a43aa98312fe1343b0: Status 404 returned error can't find the container with id 102792a2730405935c0b223f6ad9ffe9a5178cd1d6f676a43aa98312fe1343b0 Jun 03 19:31:15.814556 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:15.814497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms48c" event={"ID":"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27","Type":"ContainerStarted","Data":"102792a2730405935c0b223f6ad9ffe9a5178cd1d6f676a43aa98312fe1343b0"} Jun 03 19:31:16.711329 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:16.711291 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-868f87d7c6-hnltl" Jun 03 19:31:16.820540 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:16.820499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-qd6fh" event={"ID":"d4603db2-ed97-4049-a58e-12bafd485921","Type":"ContainerStarted","Data":"23c7848d0bcc9deb67293dc7b8c2deb94ec6734e17602d14885ccda74391dd45"} Jun 03 19:31:16.820803 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:16.820745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:31:16.838971 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:16.838905 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-qd6fh" podStartSLOduration=2.814091851 podStartE2EDuration="24.838879847s" totalImagesPullingTime="22.024787996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:16.837880458 +0000 UTC m=+95.211997499" watchObservedRunningTime="2026-06-03 19:31:16.838879847 +0000 UTC m=+95.212996885" Jun 03 19:31:16.842153 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:16.842116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-qd6fh" Jun 03 19:31:17.826535 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:17.826497 2578 generic.go:356] "Generic (PLEG): container finished" podID="e68b5669-cd1b-44e3-8be9-a9c8bd1ade27" containerID="37b6022bae3bc6dd215b44445cb6b2edd321d739f00c75fc42f2e28833b91c18" exitCode=0 Jun 03 19:31:17.827027 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:17.826583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms48c" event={"ID":"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27","Type":"ContainerDied","Data":"37b6022bae3bc6dd215b44445cb6b2edd321d739f00c75fc42f2e28833b91c18"} Jun 03 19:31:18.833464 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:18.833421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms48c" event={"ID":"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27","Type":"ContainerStarted","Data":"48e1aa790846eb05f37b36548654f7a9f567356bf7bdd9c33489a47061301d64"} Jun 03 19:31:18.833927 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:18.833493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms48c" event={"ID":"e68b5669-cd1b-44e3-8be9-a9c8bd1ade27","Type":"ContainerStarted","Data":"5146f18e0a9e41dde4ebc6dd0abfe8db7553785c91979aa718dd0268d95f2006"} Jun 03 19:31:18.855306 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:18.855251 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ms48c" podStartSLOduration=6.391186456 podStartE2EDuration="7.855233456s" totalImagesPullingTime="1.343760583s" totalInitContainerRuntime="120.286417ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:18.854352071 +0000 UTC m=+97.228469142" watchObservedRunningTime="2026-06-03 19:31:18.855233456 +0000 UTC m=+97.229350493" Jun 03 19:31:25.703177 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:25.703144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5q6z5" Jun 03 19:31:35.901381 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:35.901343 2578 generic.go:356] "Generic (PLEG): container finished" podID="b8542a33-b550-4d3f-955d-076aae969be6" containerID="1c21c13f74500f60fc05443041cc883808d914e7119aec60109e25596aebc51a" exitCode=0 Jun 03 19:31:35.901810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:35.901415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ll9k2" event={"ID":"b8542a33-b550-4d3f-955d-076aae969be6","Type":"ContainerDied","Data":"1c21c13f74500f60fc05443041cc883808d914e7119aec60109e25596aebc51a"} Jun 03 19:31:35.901810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:35.901728 2578 scope.go:117] "RemoveContainer" containerID="1c21c13f74500f60fc05443041cc883808d914e7119aec60109e25596aebc51a" Jun 03 19:31:36.455425 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.455373 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-689d999966-z6zqj" podUID="b5d691e9-04f5-4c74-ac65-8b90c821306c" containerName="console" containerID="cri-o://e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee" gracePeriod=15 Jun 03 19:31:36.499360 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.499338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fq27d_3960550a-6bfd-46ea-87e9-716901f7eaf0/serve-healthcheck-canary/0.log" Jun 03 19:31:36.738202 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.738129 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:36.830905 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.830870 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.830905 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.830912 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.831136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.830948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.831136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.830964 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.831136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.831013 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrh2p\" (UniqueName: \"kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.831136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.831037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca\") pod \"b5d691e9-04f5-4c74-ac65-8b90c821306c\" (UID: \"b5d691e9-04f5-4c74-ac65-8b90c821306c\") " Jun 03 19:31:36.831395 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.831352 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config" (OuterVolumeSpecName: "console-config") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:31:36.831395 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.831385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:31:36.831518 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.831398 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:31:36.833415 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.833381 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:31:36.833520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.833425 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:31:36.833520 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.833437 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p" (OuterVolumeSpecName: "kube-api-access-rrh2p") pod "b5d691e9-04f5-4c74-ac65-8b90c821306c" (UID: "b5d691e9-04f5-4c74-ac65-8b90c821306c"). InnerVolumeSpecName "kube-api-access-rrh2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:31:36.905867 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.905806 2578 generic.go:356] "Generic (PLEG): container finished" podID="b5d691e9-04f5-4c74-ac65-8b90c821306c" containerID="e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee" exitCode=0 Jun 03 19:31:36.906314 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.905876 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689d999966-z6zqj" Jun 03 19:31:36.906314 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.905904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689d999966-z6zqj" event={"ID":"b5d691e9-04f5-4c74-ac65-8b90c821306c","Type":"ContainerDied","Data":"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee"} Jun 03 19:31:36.906314 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.905953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689d999966-z6zqj" event={"ID":"b5d691e9-04f5-4c74-ac65-8b90c821306c","Type":"ContainerDied","Data":"575c8f4c600179e1dbae33cf2461279b1fd860f80ce936d9ccc5e5877c99aaf8"} Jun 03 19:31:36.906314 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.905976 2578 scope.go:117] "RemoveContainer" containerID="e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee" Jun 03 19:31:36.908038 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.908018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-ll9k2" event={"ID":"b8542a33-b550-4d3f-955d-076aae969be6","Type":"ContainerStarted","Data":"14b151cf6fb888d685cc2b5cbf11a937f752f45e13a0d2c1eef67379c2139e02"} Jun 03 19:31:36.916177 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.916082 2578 scope.go:117] "RemoveContainer" containerID="e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee" Jun 03 19:31:36.916541 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:31:36.916457 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee\": container with ID starting with e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee not found: ID does not exist" containerID="e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee" Jun 03 19:31:36.916541 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.916492 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee"} err="failed to get container status \"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee\": rpc error: code = NotFound desc = could not find container \"e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee\": container with ID starting with e9f731c1e9648ed4b01fa757a1de1c2f98dfa15bbd5ae17f6990f1c5c8700cee not found: ID does not exist" Jun 03 19:31:36.932242 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932199 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrh2p\" (UniqueName: \"kubernetes.io/projected/b5d691e9-04f5-4c74-ac65-8b90c821306c-kube-api-access-rrh2p\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.932242 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932236 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-service-ca\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.932435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932253 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-serving-cert\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.932435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932267 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-config\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.932435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932281 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5d691e9-04f5-4c74-ac65-8b90c821306c-console-oauth-config\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.932435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.932312 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5d691e9-04f5-4c74-ac65-8b90c821306c-oauth-serving-cert\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:31:36.942502 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.942465 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:31:36.946757 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:36.946731 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689d999966-z6zqj"] Jun 03 19:31:38.154645 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:31:38.154614 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5d691e9-04f5-4c74-ac65-8b90c821306c" path="/var/lib/kubelet/pods/b5d691e9-04f5-4c74-ac65-8b90c821306c/volumes" Jun 03 19:32:35.788656 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.788575 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:32:35.789101 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.788889 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d691e9-04f5-4c74-ac65-8b90c821306c" containerName="console" Jun 03 19:32:35.789101 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.788907 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d691e9-04f5-4c74-ac65-8b90c821306c" containerName="console" Jun 03 19:32:35.789101 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.788964 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5d691e9-04f5-4c74-ac65-8b90c821306c" containerName="console" Jun 03 19:32:35.790900 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.790874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.793654 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.793626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 19:32:35.793943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.793918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 19:32:35.794115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.793955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 19:32:35.794208 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.794193 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 19:32:35.794352 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.794327 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mmd7x\"" Jun 03 19:32:35.794501 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.794479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 19:32:35.799448 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.799039 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 19:32:35.807381 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.807354 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:32:35.915627 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915627 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2vg\" (UniqueName: \"kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915875 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915875 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915875 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915875 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:35.915875 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:35.915835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.016990 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.016951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.016990 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.016993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2vg\" (UniqueName: \"kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017219 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017774 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017915 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.017915 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.017893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.018029 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.018008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.020091 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.020064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.020287 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.020268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.026700 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.026675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2vg\" (UniqueName: \"kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg\") pod \"console-84b54974bc-62ww5\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.102814 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.102772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:36.244148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:36.244120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:32:36.246718 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:32:36.246672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d41ebe_1a72_45bf_bf70_ba9d4077519e.slice/crio-d97ecdcd9b05dd3aaeb2f45c592ca095ef6ead2e0b47c2b1b0b0850cc11d3070 WatchSource:0}: Error finding container d97ecdcd9b05dd3aaeb2f45c592ca095ef6ead2e0b47c2b1b0b0850cc11d3070: Status 404 returned error can't find the container with id d97ecdcd9b05dd3aaeb2f45c592ca095ef6ead2e0b47c2b1b0b0850cc11d3070 Jun 03 19:32:37.129035 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:37.129001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b54974bc-62ww5" event={"ID":"39d41ebe-1a72-45bf-bf70-ba9d4077519e","Type":"ContainerStarted","Data":"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2"} Jun 03 19:32:37.129449 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:37.129059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b54974bc-62ww5" event={"ID":"39d41ebe-1a72-45bf-bf70-ba9d4077519e","Type":"ContainerStarted","Data":"d97ecdcd9b05dd3aaeb2f45c592ca095ef6ead2e0b47c2b1b0b0850cc11d3070"} Jun 03 19:32:37.150537 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:37.150483 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84b54974bc-62ww5" podStartSLOduration=2.150464409 podStartE2EDuration="2.150464409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:37.148987913 +0000 UTC m=+175.523104972" watchObservedRunningTime="2026-06-03 19:32:37.150464409 +0000 UTC m=+175.524581513" Jun 03 19:32:46.103853 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:46.103810 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:46.104397 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:46.103899 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:46.108698 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:46.108675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:32:46.163569 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:32:46.163542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:33:49.036196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.036155 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz"] Jun 03 19:33:49.038478 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.038455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.041247 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.041218 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:33:49.041457 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.041442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:33:49.042287 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.042264 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:33:49.048157 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.048131 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz"] Jun 03 19:33:49.095886 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.095824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.096076 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.095914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.096076 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.095956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlnm8\" (UniqueName: \"kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.197274 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.197237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlnm8\" (UniqueName: \"kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.197469 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.197323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.197469 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.197363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.197773 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.197754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.197876 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.197771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.206922 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.206900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlnm8\" (UniqueName: \"kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.348218 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.348181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:33:49.483399 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:49.483367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz"] Jun 03 19:33:49.486526 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:33:49.486495 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865478ea_3a6f_42ff_a9a0_73f39a1992df.slice/crio-9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf WatchSource:0}: Error finding container 9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf: Status 404 returned error can't find the container with id 9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf Jun 03 19:33:50.397435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:50.397393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" event={"ID":"865478ea-3a6f-42ff-a9a0-73f39a1992df","Type":"ContainerStarted","Data":"9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf"} Jun 03 19:33:57.426543 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:57.426503 2578 generic.go:356] "Generic (PLEG): container finished" podID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerID="1b366a87c8be938dd3b0eb21af711edbd4b4f64e71360b618635f6132873f374" exitCode=0 Jun 03 19:33:57.426937 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:57.426579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" event={"ID":"865478ea-3a6f-42ff-a9a0-73f39a1992df","Type":"ContainerDied","Data":"1b366a87c8be938dd3b0eb21af711edbd4b4f64e71360b618635f6132873f374"} Jun 03 19:33:58.432163 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:58.432125 2578 generic.go:356] "Generic (PLEG): container finished" podID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerID="261cff85c7a3bd8894aa9bfdbf75bad358df3b7e00bd684b1b0f40cdc420d84f" exitCode=0 Jun 03 19:33:58.432532 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:33:58.432178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" event={"ID":"865478ea-3a6f-42ff-a9a0-73f39a1992df","Type":"ContainerDied","Data":"261cff85c7a3bd8894aa9bfdbf75bad358df3b7e00bd684b1b0f40cdc420d84f"} Jun 03 19:34:06.466390 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:06.466350 2578 generic.go:356] "Generic (PLEG): container finished" podID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerID="365b6ee71525391f4a56dda7342984a100e932fb2b83ba639b7c4ed06660ede8" exitCode=0 Jun 03 19:34:06.466881 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:06.466435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" event={"ID":"865478ea-3a6f-42ff-a9a0-73f39a1992df","Type":"ContainerDied","Data":"365b6ee71525391f4a56dda7342984a100e932fb2b83ba639b7c4ed06660ede8"} Jun 03 19:34:07.608196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.608169 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:34:07.651091 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.651057 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util\") pod \"865478ea-3a6f-42ff-a9a0-73f39a1992df\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " Jun 03 19:34:07.651278 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.651153 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlnm8\" (UniqueName: \"kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8\") pod \"865478ea-3a6f-42ff-a9a0-73f39a1992df\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " Jun 03 19:34:07.651278 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.651181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle\") pod \"865478ea-3a6f-42ff-a9a0-73f39a1992df\" (UID: \"865478ea-3a6f-42ff-a9a0-73f39a1992df\") " Jun 03 19:34:07.651836 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.651813 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle" (OuterVolumeSpecName: "bundle") pod "865478ea-3a6f-42ff-a9a0-73f39a1992df" (UID: "865478ea-3a6f-42ff-a9a0-73f39a1992df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:07.653388 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.653360 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8" (OuterVolumeSpecName: "kube-api-access-nlnm8") pod "865478ea-3a6f-42ff-a9a0-73f39a1992df" (UID: "865478ea-3a6f-42ff-a9a0-73f39a1992df"). InnerVolumeSpecName "kube-api-access-nlnm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:07.655672 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.655646 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util" (OuterVolumeSpecName: "util") pod "865478ea-3a6f-42ff-a9a0-73f39a1992df" (UID: "865478ea-3a6f-42ff-a9a0-73f39a1992df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:07.751718 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.751625 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlnm8\" (UniqueName: \"kubernetes.io/projected/865478ea-3a6f-42ff-a9a0-73f39a1992df-kube-api-access-nlnm8\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:07.751718 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.751679 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:07.751718 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:07.751690 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865478ea-3a6f-42ff-a9a0-73f39a1992df-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:08.475831 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:08.475740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" event={"ID":"865478ea-3a6f-42ff-a9a0-73f39a1992df","Type":"ContainerDied","Data":"9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf"} Jun 03 19:34:08.475831 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:08.475765 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dr6hwz" Jun 03 19:34:08.475831 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:08.475798 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c9abaa288ea9727054ff42efa54ba360f63856332b6f2a23c086dced10e8acf" Jun 03 19:34:21.523854 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.523817 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7"] Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524107 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="pull" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524120 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="pull" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524133 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="extract" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524138 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="extract" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524146 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="util" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524151 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="util" Jun 03 19:34:21.524337 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.524204 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="865478ea-3a6f-42ff-a9a0-73f39a1992df" containerName="extract" Jun 03 19:34:21.526518 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.526502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.529487 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.529462 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l9j5x\"" Jun 03 19:34:21.529613 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.529466 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 19:34:21.530607 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.530591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 19:34:21.539408 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.539384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7"] Jun 03 19:34:21.669182 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.669127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkkrj\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-kube-api-access-dkkrj\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.669376 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.669221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.770659 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.770619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.770871 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.770678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkkrj\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-kube-api-access-dkkrj\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.780049 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.779978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.780166 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.780090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkkrj\" (UniqueName: \"kubernetes.io/projected/590ca347-3ed5-4873-a034-b6e0eae462d6-kube-api-access-dkkrj\") pod \"cert-manager-cainjector-5d99449ffd-lsvk7\" (UID: \"590ca347-3ed5-4873-a034-b6e0eae462d6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.835988 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.835939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" Jun 03 19:34:21.964662 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:21.964637 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7"] Jun 03 19:34:21.967406 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:34:21.967379 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod590ca347_3ed5_4873_a034_b6e0eae462d6.slice/crio-ae4d98e859a96acb27e3fa397d82e35ca4c55846e5f037d3aa280a151f2d366a WatchSource:0}: Error finding container ae4d98e859a96acb27e3fa397d82e35ca4c55846e5f037d3aa280a151f2d366a: Status 404 returned error can't find the container with id ae4d98e859a96acb27e3fa397d82e35ca4c55846e5f037d3aa280a151f2d366a Jun 03 19:34:22.529965 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:22.529930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" event={"ID":"590ca347-3ed5-4873-a034-b6e0eae462d6","Type":"ContainerStarted","Data":"ae4d98e859a96acb27e3fa397d82e35ca4c55846e5f037d3aa280a151f2d366a"} Jun 03 19:34:25.543977 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:25.543867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" event={"ID":"590ca347-3ed5-4873-a034-b6e0eae462d6","Type":"ContainerStarted","Data":"4fd8545289a8f319eb82344cb2d8bf5038c2f2548c84622a4705e250786b3973"} Jun 03 19:34:25.563204 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:25.563149 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-lsvk7" podStartSLOduration=1.379574126 podStartE2EDuration="4.563132583s" totalImagesPullingTime="3.183558457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:25.561584715 +0000 UTC m=+283.935701753" watchObservedRunningTime="2026-06-03 19:34:25.563132583 +0000 UTC m=+283.937249616" Jun 03 19:34:42.094342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:42.094309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:34:42.097586 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:42.097563 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:34:42.102272 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:42.102247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:34:42.106075 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:42.106052 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:34:42.106238 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:42.106212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:34:49.137609 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.137569 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7"] Jun 03 19:34:49.139654 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.139638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.142357 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.142336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:34:49.142479 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.142461 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:34:49.143422 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.143402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:34:49.149865 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.149825 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7"] Jun 03 19:34:49.200620 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.200571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt49q\" (UniqueName: \"kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.200866 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.200700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.200866 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.200740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.301234 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.301189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.301234 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.301236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.301488 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.301425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt49q\" (UniqueName: \"kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.301585 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.301565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.301646 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.301618 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.311044 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.311014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt49q\" (UniqueName: \"kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.450124 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.450035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:49.583126 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.583099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7"] Jun 03 19:34:49.585578 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:34:49.585544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b5faf7_9bab_40cb_8846_2d4bb83ff8ab.slice/crio-31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a WatchSource:0}: Error finding container 31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a: Status 404 returned error can't find the container with id 31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a Jun 03 19:34:49.634558 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:49.634525 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" event={"ID":"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab","Type":"ContainerStarted","Data":"31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a"} Jun 03 19:34:50.640170 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:50.640069 2578 generic.go:356] "Generic (PLEG): container finished" podID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerID="12df768984ec221aec6c8e792083f9146240ccbebc6daeb8c695bc76279e0c2a" exitCode=0 Jun 03 19:34:50.640170 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:50.640147 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" event={"ID":"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab","Type":"ContainerDied","Data":"12df768984ec221aec6c8e792083f9146240ccbebc6daeb8c695bc76279e0c2a"} Jun 03 19:34:50.640660 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:50.640644 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:34:51.650380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:51.650345 2578 generic.go:356] "Generic (PLEG): container finished" podID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerID="543a37f1efdc3eb44c0a7b0e37d33b2186486987a6c39cc5ab6f138b85f886c0" exitCode=0 Jun 03 19:34:51.650882 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:51.650435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" event={"ID":"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab","Type":"ContainerDied","Data":"543a37f1efdc3eb44c0a7b0e37d33b2186486987a6c39cc5ab6f138b85f886c0"} Jun 03 19:34:52.656522 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:52.656483 2578 generic.go:356] "Generic (PLEG): container finished" podID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerID="1353284b20c378319bc12b0503f539b09b7dac1bf6498c8a57db426300afed90" exitCode=0 Jun 03 19:34:52.656983 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:52.656568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" event={"ID":"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab","Type":"ContainerDied","Data":"1353284b20c378319bc12b0503f539b09b7dac1bf6498c8a57db426300afed90"} Jun 03 19:34:53.802767 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.802737 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:53.839193 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.839158 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt49q\" (UniqueName: \"kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q\") pod \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " Jun 03 19:34:53.839364 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.839205 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle\") pod \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " Jun 03 19:34:53.839364 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.839243 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util\") pod \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\" (UID: \"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab\") " Jun 03 19:34:53.839955 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.839932 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle" (OuterVolumeSpecName: "bundle") pod "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" (UID: "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:53.841568 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.841391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q" (OuterVolumeSpecName: "kube-api-access-jt49q") pod "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" (UID: "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab"). InnerVolumeSpecName "kube-api-access-jt49q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:34:53.847477 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.847438 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util" (OuterVolumeSpecName: "util") pod "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" (UID: "10b5faf7-9bab-40cb-8846-2d4bb83ff8ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:34:53.871465 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871434 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4"] Jun 03 19:34:53.871739 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871727 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="util" Jun 03 19:34:53.871786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871742 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="util" Jun 03 19:34:53.871786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871753 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="extract" Jun 03 19:34:53.871786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871759 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="extract" Jun 03 19:34:53.871786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871767 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="pull" Jun 03 19:34:53.871786 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871776 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="pull" Jun 03 19:34:53.871973 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.871831 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b5faf7-9bab-40cb-8846-2d4bb83ff8ab" containerName="extract" Jun 03 19:34:53.874982 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.874962 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:53.877951 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.877927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 19:34:53.877951 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.877935 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8qfnc\"" Jun 03 19:34:53.878164 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.877992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 19:34:53.878164 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.878105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 19:34:53.878164 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.878127 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 19:34:53.878342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.878328 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:34:53.890584 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.890559 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4"] Jun 03 19:34:53.940588 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:53.940588 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/544bdc2a-528b-48b7-b506-9522e535296c-manager-config\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:53.940787 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-metrics-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:53.940787 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5rc\" (UniqueName: \"kubernetes.io/projected/544bdc2a-528b-48b7-b506-9522e535296c-kube-api-access-gm5rc\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:53.940787 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940705 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt49q\" (UniqueName: \"kubernetes.io/projected/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-kube-api-access-jt49q\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:53.940787 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940716 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:53.940787 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:53.940725 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10b5faf7-9bab-40cb-8846-2d4bb83ff8ab-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:34:54.041317 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.041274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.041495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.041338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/544bdc2a-528b-48b7-b506-9522e535296c-manager-config\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.041495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.041360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-metrics-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.041495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.041379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5rc\" (UniqueName: \"kubernetes.io/projected/544bdc2a-528b-48b7-b506-9522e535296c-kube-api-access-gm5rc\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.042067 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.042047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/544bdc2a-528b-48b7-b506-9522e535296c-manager-config\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.043855 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.043824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.043968 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.043886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/544bdc2a-528b-48b7-b506-9522e535296c-metrics-cert\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.051069 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.051048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5rc\" (UniqueName: \"kubernetes.io/projected/544bdc2a-528b-48b7-b506-9522e535296c-kube-api-access-gm5rc\") pod \"lws-controller-manager-7db96c8d84-mxzf4\" (UID: \"544bdc2a-528b-48b7-b506-9522e535296c\") " pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.184064 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.184030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:54.328200 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.328161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4"] Jun 03 19:34:54.331213 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:34:54.331185 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544bdc2a_528b_48b7_b506_9522e535296c.slice/crio-eae91c04fd35e99d497744c4bfa8c95a1d0ec821a707fdd2c3da7200a6f129b1 WatchSource:0}: Error finding container eae91c04fd35e99d497744c4bfa8c95a1d0ec821a707fdd2c3da7200a6f129b1: Status 404 returned error can't find the container with id eae91c04fd35e99d497744c4bfa8c95a1d0ec821a707fdd2c3da7200a6f129b1 Jun 03 19:34:54.666639 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.666606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" event={"ID":"544bdc2a-528b-48b7-b506-9522e535296c","Type":"ContainerStarted","Data":"eae91c04fd35e99d497744c4bfa8c95a1d0ec821a707fdd2c3da7200a6f129b1"} Jun 03 19:34:54.668367 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.668344 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" event={"ID":"10b5faf7-9bab-40cb-8846-2d4bb83ff8ab","Type":"ContainerDied","Data":"31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a"} Jun 03 19:34:54.668512 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.668375 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd92nr7" Jun 03 19:34:54.668512 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:54.668380 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31ae51e62d10d56bd3fa339a4f3a3a49a0e76cab98c6962c4055be9a0db2148a" Jun 03 19:34:58.687079 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:58.687044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" event={"ID":"544bdc2a-528b-48b7-b506-9522e535296c","Type":"ContainerStarted","Data":"491f50235ce2e048aaa0cd3dbc8bc28dc3f35624f07657d04adfe25d49711061"} Jun 03 19:34:58.687553 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:58.687106 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:34:58.703140 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:34:58.703069 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" podStartSLOduration=2.153351304 podStartE2EDuration="5.703051968s" totalImagesPullingTime="3.549700664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:58.70270947 +0000 UTC m=+317.076826521" watchObservedRunningTime="2026-06-03 19:34:58.703051968 +0000 UTC m=+317.077169004" Jun 03 19:35:06.653474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.653437 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn"] Jun 03 19:35:06.657213 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.657186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.660546 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.660506 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:35:06.660711 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.660646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:35:06.660711 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.660655 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:35:06.660869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.660772 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-96mg5\"" Jun 03 19:35:06.660869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.660827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:35:06.682696 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.682649 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn"] Jun 03 19:35:06.747206 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.747164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.747419 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.747208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.747419 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.747334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6c7z\" (UniqueName: \"kubernetes.io/projected/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-kube-api-access-f6c7z\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.747419 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.747384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.747538 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.747470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.848557 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.848522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c7z\" (UniqueName: \"kubernetes.io/projected/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-kube-api-access-f6c7z\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.848721 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.848568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.848866 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.848814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.848943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.848926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.849018 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.848965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.849262 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.849235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-manifests\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.850966 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.850942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-tmp\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.851331 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.851310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.851391 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.851310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.858345 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.858309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6c7z\" (UniqueName: \"kubernetes.io/projected/dd4c24fb-8ac7-4492-aab0-d8b057ed59d6-kube-api-access-f6c7z\") pod \"opendatahub-operator-controller-manager-84dd8f948c-ckjvn\" (UID: \"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6\") " pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:06.968155 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:06.968057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:07.111120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:07.111089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn"] Jun 03 19:35:07.113590 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:35:07.113560 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4c24fb_8ac7_4492_aab0_d8b057ed59d6.slice/crio-ed055e0f3d33ba5b008160138033299327ccae64b7eda5db785b1103727bd42c WatchSource:0}: Error finding container ed055e0f3d33ba5b008160138033299327ccae64b7eda5db785b1103727bd42c: Status 404 returned error can't find the container with id ed055e0f3d33ba5b008160138033299327ccae64b7eda5db785b1103727bd42c Jun 03 19:35:07.724703 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:07.724627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" event={"ID":"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6","Type":"ContainerStarted","Data":"ed055e0f3d33ba5b008160138033299327ccae64b7eda5db785b1103727bd42c"} Jun 03 19:35:09.694146 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:09.694107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7db96c8d84-mxzf4" Jun 03 19:35:10.741348 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:10.741290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" event={"ID":"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6","Type":"ContainerStarted","Data":"259aef29e00f0124e513c6ed1ca9bce8a4b279745e272bbdfd7b0e6ad471db72"} Jun 03 19:35:11.748261 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:11.748222 2578 generic.go:356] "Generic (PLEG): container finished" podID="dd4c24fb-8ac7-4492-aab0-d8b057ed59d6" containerID="259aef29e00f0124e513c6ed1ca9bce8a4b279745e272bbdfd7b0e6ad471db72" exitCode=0 Jun 03 19:35:11.748261 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:11.748250 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" event={"ID":"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6","Type":"ContainerDied","Data":"259aef29e00f0124e513c6ed1ca9bce8a4b279745e272bbdfd7b0e6ad471db72"} Jun 03 19:35:12.754228 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:12.754191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" event={"ID":"dd4c24fb-8ac7-4492-aab0-d8b057ed59d6","Type":"ContainerStarted","Data":"d5ba155c03b0092b2f4af6ab49755029a9118581c1cbf818c93cc2537c3a6028"} Jun 03 19:35:12.754604 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:12.754326 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:12.780181 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:12.780127 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" podStartSLOduration=2.557952593 podStartE2EDuration="6.780109673s" totalImagesPullingTime="3.299550897s" totalInitContainerRuntime="922.606183ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:12.778595372 +0000 UTC m=+331.152712421" watchObservedRunningTime="2026-06-03 19:35:12.780109673 +0000 UTC m=+331.154226710" Jun 03 19:35:23.760584 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:23.760547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84dd8f948c-ckjvn" Jun 03 19:35:56.382652 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.382565 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-dlwjr"] Jun 03 19:35:56.386119 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.386096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.389683 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.389658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9bk22\"" Jun 03 19:35:56.389817 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.389726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:35:56.398128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.398098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-dlwjr"] Jun 03 19:35:56.479414 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.479372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d07e5796-a19f-43f4-94b5-92d345511848-redirect-config\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.479601 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.479452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbj8t\" (UniqueName: \"kubernetes.io/projected/d07e5796-a19f-43f4-94b5-92d345511848-kube-api-access-xbj8t\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.580674 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.580627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbj8t\" (UniqueName: \"kubernetes.io/projected/d07e5796-a19f-43f4-94b5-92d345511848-kube-api-access-xbj8t\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.580826 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.580700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d07e5796-a19f-43f4-94b5-92d345511848-redirect-config\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.581403 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.581374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d07e5796-a19f-43f4-94b5-92d345511848-redirect-config\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.590144 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.590116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbj8t\" (UniqueName: \"kubernetes.io/projected/d07e5796-a19f-43f4-94b5-92d345511848-kube-api-access-xbj8t\") pod \"dashboard-redirect-7f58cfb955-dlwjr\" (UID: \"d07e5796-a19f-43f4-94b5-92d345511848\") " pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.697420 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.697320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" Jun 03 19:35:56.843201 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.843158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f58cfb955-dlwjr"] Jun 03 19:35:56.845811 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:35:56.845782 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07e5796_a19f_43f4_94b5_92d345511848.slice/crio-bbfb219990a894a66d0395dc5e7d3c0c2df0ad863f59586b33a7878a4b59f7e2 WatchSource:0}: Error finding container bbfb219990a894a66d0395dc5e7d3c0c2df0ad863f59586b33a7878a4b59f7e2: Status 404 returned error can't find the container with id bbfb219990a894a66d0395dc5e7d3c0c2df0ad863f59586b33a7878a4b59f7e2 Jun 03 19:35:56.938693 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:35:56.938653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" event={"ID":"d07e5796-a19f-43f4-94b5-92d345511848","Type":"ContainerStarted","Data":"bbfb219990a894a66d0395dc5e7d3c0c2df0ad863f59586b33a7878a4b59f7e2"} Jun 03 19:36:01.963532 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:01.963489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" event={"ID":"d07e5796-a19f-43f4-94b5-92d345511848","Type":"ContainerStarted","Data":"578b1092ea083282544b1224bb6968048d6568bc7d8a3054e4c3ed791420c0f6"} Jun 03 19:36:01.987230 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:01.987175 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7f58cfb955-dlwjr" podStartSLOduration=0.977230768 podStartE2EDuration="5.987158337s" totalImagesPullingTime="5.009927569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:01.986257025 +0000 UTC m=+380.360374062" watchObservedRunningTime="2026-06-03 19:36:01.987158337 +0000 UTC m=+380.361275374" Jun 03 19:36:19.895115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.895080 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk"] Jun 03 19:36:19.901623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.901593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:19.905252 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.905228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:36:19.905489 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.905473 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cndcm\"" Jun 03 19:36:19.905674 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.905659 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:36:19.905749 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.905734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:36:19.914191 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:19.914161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk"] Jun 03 19:36:20.088923 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.088880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.088923 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.088927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.088955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.088978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvlk7\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-kube-api-access-nvlk7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.089007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.089037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.089079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.089100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df27b98d-d034-4ec2-b3f7-112a29098eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.089128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.089118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190173 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190173 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df27b98d-d034-4ec2-b3f7-112a29098eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190173 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlk7\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-kube-api-access-nvlk7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190445 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190724 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190512 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190724 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190724 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190866 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.190956 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.190938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df27b98d-d034-4ec2-b3f7-112a29098eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.192684 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.192657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.192943 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.192927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.204198 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.204168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.206435 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.206407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvlk7\" (UniqueName: \"kubernetes.io/projected/df27b98d-d034-4ec2-b3f7-112a29098eaf-kube-api-access-nvlk7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mtgfk\" (UID: \"df27b98d-d034-4ec2-b3f7-112a29098eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.212290 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.212265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:20.356547 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:20.356486 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk"] Jun 03 19:36:20.358678 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:20.358646 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf27b98d_d034_4ec2_b3f7_112a29098eaf.slice/crio-c37be0b78d3e2d9a8e303ab53e8d02b5ab6ecdc4c2d10cbc08f86a8b7fc0f9c1 WatchSource:0}: Error finding container c37be0b78d3e2d9a8e303ab53e8d02b5ab6ecdc4c2d10cbc08f86a8b7fc0f9c1: Status 404 returned error can't find the container with id c37be0b78d3e2d9a8e303ab53e8d02b5ab6ecdc4c2d10cbc08f86a8b7fc0f9c1 Jun 03 19:36:21.048627 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:21.048591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" event={"ID":"df27b98d-d034-4ec2-b3f7-112a29098eaf","Type":"ContainerStarted","Data":"c37be0b78d3e2d9a8e303ab53e8d02b5ab6ecdc4c2d10cbc08f86a8b7fc0f9c1"} Jun 03 19:36:23.950398 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:23.950361 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 19:36:23.950753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:23.950470 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 19:36:23.950753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:23.950515 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 19:36:24.064469 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:24.064434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" event={"ID":"df27b98d-d034-4ec2-b3f7-112a29098eaf","Type":"ContainerStarted","Data":"b24c0a290149303b2f9383cdfa5085438d11c998e1da6d2605ea864b1a7d95a7"} Jun 03 19:36:24.085052 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:24.084981 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" podStartSLOduration=1.495530223 podStartE2EDuration="5.084957942s" totalImagesPullingTime="3.589427719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:24.084457624 +0000 UTC m=+402.458574683" watchObservedRunningTime="2026-06-03 19:36:24.084957942 +0000 UTC m=+402.459074983" Jun 03 19:36:24.213011 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:24.212917 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:25.217735 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.217700 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:25.710148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.710081 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7764b6df-6rr79"] Jun 03 19:36:25.713525 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.713501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.725241 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.725207 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7764b6df-6rr79"] Jun 03 19:36:25.735115 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-oauth-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735273 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-oauth-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735273 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w7p9\" (UniqueName: \"kubernetes.io/projected/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-kube-api-access-2w7p9\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-service-ca\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735425 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-trusted-ca-bundle\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.735425 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.735387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.835976 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.835930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-service-ca\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.835976 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.835975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-trusted-ca-bundle\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-oauth-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836272 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-oauth-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836317 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w7p9\" (UniqueName: \"kubernetes.io/projected/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-kube-api-access-2w7p9\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836386 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836747 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-service-ca\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836900 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-oauth-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.836991 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.836968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-trusted-ca-bundle\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.837055 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.837039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.838667 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.838641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-serving-cert\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.838751 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.838664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-console-oauth-config\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:25.845740 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:25.845714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w7p9\" (UniqueName: \"kubernetes.io/projected/1ac86d31-e5d0-47d1-b2d3-580f3fe35909-kube-api-access-2w7p9\") pod \"console-6d7764b6df-6rr79\" (UID: \"1ac86d31-e5d0-47d1-b2d3-580f3fe35909\") " pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:26.023574 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:26.023473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:26.075639 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:26.075415 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:26.076734 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:26.076700 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mtgfk" Jun 03 19:36:26.179040 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:26.179016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7764b6df-6rr79"] Jun 03 19:36:26.181212 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:26.181183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac86d31_e5d0_47d1_b2d3_580f3fe35909.slice/crio-aeb34339a489c0d17ef259034a9ff9ee46c8607c67f8eea15a71396829e00fe6 WatchSource:0}: Error finding container aeb34339a489c0d17ef259034a9ff9ee46c8607c67f8eea15a71396829e00fe6: Status 404 returned error can't find the container with id aeb34339a489c0d17ef259034a9ff9ee46c8607c67f8eea15a71396829e00fe6 Jun 03 19:36:27.044774 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.044736 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:27.048217 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.048195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:27.051602 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.051572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:36:27.052343 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.052309 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:36:27.052478 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.052317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9ldxx\"" Jun 03 19:36:27.057681 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.057597 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:27.081802 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.081750 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7764b6df-6rr79" event={"ID":"1ac86d31-e5d0-47d1-b2d3-580f3fe35909","Type":"ContainerStarted","Data":"397972a283086419e642f04633dd92dcce03e834014bf13a67ae3d30a5b695eb"} Jun 03 19:36:27.082010 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.081817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7764b6df-6rr79" event={"ID":"1ac86d31-e5d0-47d1-b2d3-580f3fe35909","Type":"ContainerStarted","Data":"aeb34339a489c0d17ef259034a9ff9ee46c8607c67f8eea15a71396829e00fe6"} Jun 03 19:36:27.102151 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.102096 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7764b6df-6rr79" podStartSLOduration=2.1020809639999998 podStartE2EDuration="2.102080964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:27.101120988 +0000 UTC m=+405.475238058" watchObservedRunningTime="2026-06-03 19:36:27.102080964 +0000 UTC m=+405.476198030" Jun 03 19:36:27.146726 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.146675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89bzg\" (UniqueName: \"kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg\") pod \"kuadrant-operator-catalog-w2fn9\" (UID: \"ab3f4783-24a1-40d2-bac4-9f72909dee33\") " pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:27.248237 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.248194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89bzg\" (UniqueName: \"kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg\") pod \"kuadrant-operator-catalog-w2fn9\" (UID: \"ab3f4783-24a1-40d2-bac4-9f72909dee33\") " pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:27.257660 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.257610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89bzg\" (UniqueName: \"kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg\") pod \"kuadrant-operator-catalog-w2fn9\" (UID: \"ab3f4783-24a1-40d2-bac4-9f72909dee33\") " pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:27.360879 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.360816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:27.405336 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.405297 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:27.497236 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.497211 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:27.499164 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:27.499128 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3f4783_24a1_40d2_bac4_9f72909dee33.slice/crio-fe26806b2a3cd2dace0f4ebbedbc78533316e40d09194bd72fb8f003f2c104b4 WatchSource:0}: Error finding container fe26806b2a3cd2dace0f4ebbedbc78533316e40d09194bd72fb8f003f2c104b4: Status 404 returned error can't find the container with id fe26806b2a3cd2dace0f4ebbedbc78533316e40d09194bd72fb8f003f2c104b4 Jun 03 19:36:27.614306 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.614223 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w9l9f"] Jun 03 19:36:27.618649 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.618630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:27.627061 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.627036 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w9l9f"] Jun 03 19:36:27.651545 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.651501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhm7g\" (UniqueName: \"kubernetes.io/projected/4fee6f5f-8602-409e-b1b2-9880758c334b-kube-api-access-vhm7g\") pod \"kuadrant-operator-catalog-w9l9f\" (UID: \"4fee6f5f-8602-409e-b1b2-9880758c334b\") " pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:27.752001 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.751964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhm7g\" (UniqueName: \"kubernetes.io/projected/4fee6f5f-8602-409e-b1b2-9880758c334b-kube-api-access-vhm7g\") pod \"kuadrant-operator-catalog-w9l9f\" (UID: \"4fee6f5f-8602-409e-b1b2-9880758c334b\") " pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:27.761812 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.761785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhm7g\" (UniqueName: \"kubernetes.io/projected/4fee6f5f-8602-409e-b1b2-9880758c334b-kube-api-access-vhm7g\") pod \"kuadrant-operator-catalog-w9l9f\" (UID: \"4fee6f5f-8602-409e-b1b2-9880758c334b\") " pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:27.929262 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:27.929166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:28.066046 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:28.066016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w9l9f"] Jun 03 19:36:28.068325 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:28.068293 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fee6f5f_8602_409e_b1b2_9880758c334b.slice/crio-acb88c40d690003128478540e8bf84aa4212847930f3a9cc80968dc0d0a5f70b WatchSource:0}: Error finding container acb88c40d690003128478540e8bf84aa4212847930f3a9cc80968dc0d0a5f70b: Status 404 returned error can't find the container with id acb88c40d690003128478540e8bf84aa4212847930f3a9cc80968dc0d0a5f70b Jun 03 19:36:28.087888 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:28.087849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" event={"ID":"ab3f4783-24a1-40d2-bac4-9f72909dee33","Type":"ContainerStarted","Data":"fe26806b2a3cd2dace0f4ebbedbc78533316e40d09194bd72fb8f003f2c104b4"} Jun 03 19:36:28.088966 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:28.088933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" event={"ID":"4fee6f5f-8602-409e-b1b2-9880758c334b","Type":"ContainerStarted","Data":"acb88c40d690003128478540e8bf84aa4212847930f3a9cc80968dc0d0a5f70b"} Jun 03 19:36:30.101485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.101441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" event={"ID":"4fee6f5f-8602-409e-b1b2-9880758c334b","Type":"ContainerStarted","Data":"003649db1af56f7a4fd78cebba896477da5ef7d4d05a0861f72eef40745c85e3"} Jun 03 19:36:30.102829 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.102806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" event={"ID":"ab3f4783-24a1-40d2-bac4-9f72909dee33","Type":"ContainerStarted","Data":"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d"} Jun 03 19:36:30.102957 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.102886 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" podUID="ab3f4783-24a1-40d2-bac4-9f72909dee33" containerName="registry-server" containerID="cri-o://3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d" gracePeriod=2 Jun 03 19:36:30.118495 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.118403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" podStartSLOduration=1.368963382 podStartE2EDuration="3.118389319s" totalImagesPullingTime="1.749425937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:30.117338441 +0000 UTC m=+408.491455477" watchObservedRunningTime="2026-06-03 19:36:30.118389319 +0000 UTC m=+408.492506355" Jun 03 19:36:30.134181 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.134138 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" podStartSLOduration=0.833973058 podStartE2EDuration="3.134123707s" totalImagesPullingTime="2.300150649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:30.132344209 +0000 UTC m=+408.506461257" watchObservedRunningTime="2026-06-03 19:36:30.134123707 +0000 UTC m=+408.508240745" Jun 03 19:36:30.350048 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.350016 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:30.378102 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.378024 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89bzg\" (UniqueName: \"kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg\") pod \"ab3f4783-24a1-40d2-bac4-9f72909dee33\" (UID: \"ab3f4783-24a1-40d2-bac4-9f72909dee33\") " Jun 03 19:36:30.380238 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.380213 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg" (OuterVolumeSpecName: "kube-api-access-89bzg") pod "ab3f4783-24a1-40d2-bac4-9f72909dee33" (UID: "ab3f4783-24a1-40d2-bac4-9f72909dee33"). InnerVolumeSpecName "kube-api-access-89bzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:30.479109 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:30.479074 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89bzg\" (UniqueName: \"kubernetes.io/projected/ab3f4783-24a1-40d2-bac4-9f72909dee33-kube-api-access-89bzg\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:31.108663 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.108580 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab3f4783-24a1-40d2-bac4-9f72909dee33" containerID="3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d" exitCode=0 Jun 03 19:36:31.108663 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.108620 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" Jun 03 19:36:31.109176 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.108674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" event={"ID":"ab3f4783-24a1-40d2-bac4-9f72909dee33","Type":"ContainerDied","Data":"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d"} Jun 03 19:36:31.109176 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.108725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2fn9" event={"ID":"ab3f4783-24a1-40d2-bac4-9f72909dee33","Type":"ContainerDied","Data":"fe26806b2a3cd2dace0f4ebbedbc78533316e40d09194bd72fb8f003f2c104b4"} Jun 03 19:36:31.109176 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.108752 2578 scope.go:117] "RemoveContainer" containerID="3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d" Jun 03 19:36:31.117667 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.117645 2578 scope.go:117] "RemoveContainer" containerID="3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d" Jun 03 19:36:31.117992 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:36:31.117974 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d\": container with ID starting with 3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d not found: ID does not exist" containerID="3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d" Jun 03 19:36:31.118037 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.118002 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d"} err="failed to get container status \"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d\": rpc error: code = NotFound desc = could not find container \"3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d\": container with ID starting with 3dfed2633888f1c58789b8beb98f5bbb8fc9d919928c7c04f4854bd339141b5d not found: ID does not exist" Jun 03 19:36:31.129878 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.129829 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:31.133634 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:31.133607 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2fn9"] Jun 03 19:36:32.155208 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:32.155166 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab3f4783-24a1-40d2-bac4-9f72909dee33" path="/var/lib/kubelet/pods/ab3f4783-24a1-40d2-bac4-9f72909dee33/volumes" Jun 03 19:36:36.023932 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:36.023880 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:36.024310 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:36.023972 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:36.028951 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:36.028920 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:36.135917 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:36.135886 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7764b6df-6rr79" Jun 03 19:36:36.184057 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:36.184020 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:36:37.929785 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:37.929729 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:37.930244 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:37.929818 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:37.951692 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:37.951657 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:38.165370 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:38.165342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-w9l9f" Jun 03 19:36:42.385446 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.385348 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6"] Jun 03 19:36:42.385922 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.385814 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3f4783-24a1-40d2-bac4-9f72909dee33" containerName="registry-server" Jun 03 19:36:42.385922 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.385832 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3f4783-24a1-40d2-bac4-9f72909dee33" containerName="registry-server" Jun 03 19:36:42.386046 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.385941 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3f4783-24a1-40d2-bac4-9f72909dee33" containerName="registry-server" Jun 03 19:36:42.390528 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.390504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.393042 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.393011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x7vrp\"" Jun 03 19:36:42.397726 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.397705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6"] Jun 03 19:36:42.491746 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.491703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.491972 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.491780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpg9\" (UniqueName: \"kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.491972 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.491866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.592622 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.592584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.592816 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.592669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpg9\" (UniqueName: \"kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.592816 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.592710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.593044 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.593012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.593171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.593058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.601449 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.601424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpg9\" (UniqueName: \"kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.701058 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.700979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:42.837081 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.837052 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6"] Jun 03 19:36:42.839521 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:42.839486 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845a5d57_31fd_4602_9fb6_98e09384b6dd.slice/crio-2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46 WatchSource:0}: Error finding container 2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46: Status 404 returned error can't find the container with id 2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46 Jun 03 19:36:42.985490 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.985407 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl"] Jun 03 19:36:42.988617 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.988600 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:42.997460 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:42.997429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl"] Jun 03 19:36:43.096984 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.096943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.097136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.096988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqd5k\" (UniqueName: \"kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.097136 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.097029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.164320 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.164285 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerID="ae95ef39d34d946e2f672ac644621fc3be66683f80f69968d910c8e390cbb557" exitCode=0 Jun 03 19:36:43.164475 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.164362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" event={"ID":"845a5d57-31fd-4602-9fb6-98e09384b6dd","Type":"ContainerDied","Data":"ae95ef39d34d946e2f672ac644621fc3be66683f80f69968d910c8e390cbb557"} Jun 03 19:36:43.164475 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.164403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" event={"ID":"845a5d57-31fd-4602-9fb6-98e09384b6dd","Type":"ContainerStarted","Data":"2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46"} Jun 03 19:36:43.198008 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.197974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.198199 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.198071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.198199 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.198103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqd5k\" (UniqueName: \"kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.198351 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.198329 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.198466 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.198446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.208122 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.208100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqd5k\" (UniqueName: \"kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.307855 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.307812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:43.465637 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.465605 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl"] Jun 03 19:36:43.467794 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:43.467763 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0dbd68_4253_4f5a_81a6_e96d6d728638.slice/crio-6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed WatchSource:0}: Error finding container 6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed: Status 404 returned error can't find the container with id 6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed Jun 03 19:36:43.587387 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.587353 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5"] Jun 03 19:36:43.590824 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.590798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.599382 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.599346 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5"] Jun 03 19:36:43.707833 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.707786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.708057 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.707872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.708057 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.707916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxvn\" (UniqueName: \"kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.808949 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.808909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.809150 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.808970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.809150 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.809018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxvn\" (UniqueName: \"kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.809431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.809400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.809431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.809419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.819135 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.819065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxvn\" (UniqueName: \"kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:43.950625 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:43.950596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:44.033005 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.032963 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j"] Jun 03 19:36:44.037396 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.037346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.050965 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.050926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j"] Jun 03 19:36:44.095201 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.095121 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5"] Jun 03 19:36:44.112869 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.112826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.113017 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.112890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.113017 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.112941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2j4\" (UniqueName: \"kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.130855 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:44.130808 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86127117_ff35_4afb_92e5_a5b3b4b78080.slice/crio-f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46 WatchSource:0}: Error finding container f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46: Status 404 returned error can't find the container with id f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46 Jun 03 19:36:44.169813 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.169782 2578 generic.go:356] "Generic (PLEG): container finished" podID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerID="e37a3d675e382345aaab06b91d08bcd631ba7af6e68dca16c1bfcd726f085c95" exitCode=0 Jun 03 19:36:44.169962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.169875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" event={"ID":"2b0dbd68-4253-4f5a-81a6-e96d6d728638","Type":"ContainerDied","Data":"e37a3d675e382345aaab06b91d08bcd631ba7af6e68dca16c1bfcd726f085c95"} Jun 03 19:36:44.169962 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.169924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" event={"ID":"2b0dbd68-4253-4f5a-81a6-e96d6d728638","Type":"ContainerStarted","Data":"6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed"} Jun 03 19:36:44.171902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.171879 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerID="6366aacefe4670939af9387762b9de27403cb38317c1e9fe9078230a5598b83e" exitCode=0 Jun 03 19:36:44.171993 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.171962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" event={"ID":"845a5d57-31fd-4602-9fb6-98e09384b6dd","Type":"ContainerDied","Data":"6366aacefe4670939af9387762b9de27403cb38317c1e9fe9078230a5598b83e"} Jun 03 19:36:44.173317 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.173294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" event={"ID":"86127117-ff35-4afb-92e5-a5b3b4b78080","Type":"ContainerStarted","Data":"f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46"} Jun 03 19:36:44.213990 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.213961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2j4\" (UniqueName: \"kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.214151 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.214068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.214292 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.214263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.214468 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.214448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.214559 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.214542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.223082 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.223047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2j4\" (UniqueName: \"kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.352116 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.352020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:44.488305 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:44.488273 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j"] Jun 03 19:36:44.490120 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:36:44.490090 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fad048a_3362_401b_a698_38d8bbbe9e0a.slice/crio-f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126 WatchSource:0}: Error finding container f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126: Status 404 returned error can't find the container with id f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126 Jun 03 19:36:45.180194 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.180096 2578 generic.go:356] "Generic (PLEG): container finished" podID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerID="d67a6318f55ce6da35d5fc3dd12ec058ecbfc2e051b0de98c83c330b51d2c3f2" exitCode=0 Jun 03 19:36:45.180353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.180185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" event={"ID":"2b0dbd68-4253-4f5a-81a6-e96d6d728638","Type":"ContainerDied","Data":"d67a6318f55ce6da35d5fc3dd12ec058ecbfc2e051b0de98c83c330b51d2c3f2"} Jun 03 19:36:45.181753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.181674 2578 generic.go:356] "Generic (PLEG): container finished" podID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerID="5c8d05faec869e39dfcff9ee75d79be1e83355f7ebf226de953cfd1f53b4ab91" exitCode=0 Jun 03 19:36:45.181829 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.181757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" event={"ID":"5fad048a-3362-401b-a698-38d8bbbe9e0a","Type":"ContainerDied","Data":"5c8d05faec869e39dfcff9ee75d79be1e83355f7ebf226de953cfd1f53b4ab91"} Jun 03 19:36:45.181829 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.181796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" event={"ID":"5fad048a-3362-401b-a698-38d8bbbe9e0a","Type":"ContainerStarted","Data":"f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126"} Jun 03 19:36:45.183949 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.183928 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerID="3f0a627cc549cd7613512b9b6d83e0168023278fab3075cbc0c5a6d11e50b227" exitCode=0 Jun 03 19:36:45.184062 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.184010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" event={"ID":"845a5d57-31fd-4602-9fb6-98e09384b6dd","Type":"ContainerDied","Data":"3f0a627cc549cd7613512b9b6d83e0168023278fab3075cbc0c5a6d11e50b227"} Jun 03 19:36:45.185593 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.185567 2578 generic.go:356] "Generic (PLEG): container finished" podID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerID="1fb175ec3642e641b0f671f1df0949e76771dd4042b5bea83adb74c440e32eae" exitCode=0 Jun 03 19:36:45.185710 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:45.185587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" event={"ID":"86127117-ff35-4afb-92e5-a5b3b4b78080","Type":"ContainerDied","Data":"1fb175ec3642e641b0f671f1df0949e76771dd4042b5bea83adb74c440e32eae"} Jun 03 19:36:46.194107 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.194030 2578 generic.go:356] "Generic (PLEG): container finished" podID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerID="6295dd0b7b0fa16937697c1fc8f6ccf882193758ab17807d99fc007e9079d704" exitCode=0 Jun 03 19:36:46.194506 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.194119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" event={"ID":"86127117-ff35-4afb-92e5-a5b3b4b78080","Type":"ContainerDied","Data":"6295dd0b7b0fa16937697c1fc8f6ccf882193758ab17807d99fc007e9079d704"} Jun 03 19:36:46.196171 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.196147 2578 generic.go:356] "Generic (PLEG): container finished" podID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerID="2fd3ab671c30765b97d702e70ed55170c39f21d33b33ed746724d97e59b23118" exitCode=0 Jun 03 19:36:46.196258 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.196215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" event={"ID":"2b0dbd68-4253-4f5a-81a6-e96d6d728638","Type":"ContainerDied","Data":"2fd3ab671c30765b97d702e70ed55170c39f21d33b33ed746724d97e59b23118"} Jun 03 19:36:46.341124 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.341086 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:46.435063 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.435025 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle\") pod \"845a5d57-31fd-4602-9fb6-98e09384b6dd\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " Jun 03 19:36:46.435260 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.435165 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bpg9\" (UniqueName: \"kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9\") pod \"845a5d57-31fd-4602-9fb6-98e09384b6dd\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " Jun 03 19:36:46.435260 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.435224 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util\") pod \"845a5d57-31fd-4602-9fb6-98e09384b6dd\" (UID: \"845a5d57-31fd-4602-9fb6-98e09384b6dd\") " Jun 03 19:36:46.435568 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.435541 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle" (OuterVolumeSpecName: "bundle") pod "845a5d57-31fd-4602-9fb6-98e09384b6dd" (UID: "845a5d57-31fd-4602-9fb6-98e09384b6dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:46.437250 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.437231 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9" (OuterVolumeSpecName: "kube-api-access-2bpg9") pod "845a5d57-31fd-4602-9fb6-98e09384b6dd" (UID: "845a5d57-31fd-4602-9fb6-98e09384b6dd"). InnerVolumeSpecName "kube-api-access-2bpg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:46.440880 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.440855 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util" (OuterVolumeSpecName: "util") pod "845a5d57-31fd-4602-9fb6-98e09384b6dd" (UID: "845a5d57-31fd-4602-9fb6-98e09384b6dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:46.536120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.536013 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bpg9\" (UniqueName: \"kubernetes.io/projected/845a5d57-31fd-4602-9fb6-98e09384b6dd-kube-api-access-2bpg9\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:46.536120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.536063 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:46.536120 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:46.536073 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a5d57-31fd-4602-9fb6-98e09384b6dd-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:47.202642 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.202546 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" Jun 03 19:36:47.202642 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.202545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6" event={"ID":"845a5d57-31fd-4602-9fb6-98e09384b6dd","Type":"ContainerDied","Data":"2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46"} Jun 03 19:36:47.203172 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.202675 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a091fdff2fde8b394f6b903ebc61c8e8ad2feda3e2dc94d6376752600102f46" Jun 03 19:36:47.204621 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.204596 2578 generic.go:356] "Generic (PLEG): container finished" podID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerID="b0cbe0cad9d5c74faf40dbcc2ec276bd1d2715dff43310d3f3e93bcebb99d774" exitCode=0 Jun 03 19:36:47.204761 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.204682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" event={"ID":"86127117-ff35-4afb-92e5-a5b3b4b78080","Type":"ContainerDied","Data":"b0cbe0cad9d5c74faf40dbcc2ec276bd1d2715dff43310d3f3e93bcebb99d774"} Jun 03 19:36:47.206501 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.206475 2578 generic.go:356] "Generic (PLEG): container finished" podID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerID="08003bc5c3588de8e10557195b44ed45c1c327de0b26b643d975c2a624f11aea" exitCode=0 Jun 03 19:36:47.206627 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.206550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" event={"ID":"5fad048a-3362-401b-a698-38d8bbbe9e0a","Type":"ContainerDied","Data":"08003bc5c3588de8e10557195b44ed45c1c327de0b26b643d975c2a624f11aea"} Jun 03 19:36:47.349700 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.349670 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:47.443128 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.443092 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqd5k\" (UniqueName: \"kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k\") pod \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " Jun 03 19:36:47.443316 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.443181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util\") pod \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " Jun 03 19:36:47.443316 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.443263 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle\") pod \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\" (UID: \"2b0dbd68-4253-4f5a-81a6-e96d6d728638\") " Jun 03 19:36:47.443810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.443788 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle" (OuterVolumeSpecName: "bundle") pod "2b0dbd68-4253-4f5a-81a6-e96d6d728638" (UID: "2b0dbd68-4253-4f5a-81a6-e96d6d728638"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:47.445370 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.445348 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k" (OuterVolumeSpecName: "kube-api-access-dqd5k") pod "2b0dbd68-4253-4f5a-81a6-e96d6d728638" (UID: "2b0dbd68-4253-4f5a-81a6-e96d6d728638"). InnerVolumeSpecName "kube-api-access-dqd5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:47.448702 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.448662 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util" (OuterVolumeSpecName: "util") pod "2b0dbd68-4253-4f5a-81a6-e96d6d728638" (UID: "2b0dbd68-4253-4f5a-81a6-e96d6d728638"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:47.544268 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.544167 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:47.544268 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.544204 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b0dbd68-4253-4f5a-81a6-e96d6d728638-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:47.544268 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:47.544217 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqd5k\" (UniqueName: \"kubernetes.io/projected/2b0dbd68-4253-4f5a-81a6-e96d6d728638-kube-api-access-dqd5k\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:48.213799 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.213769 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" Jun 03 19:36:48.214230 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.213768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl" event={"ID":"2b0dbd68-4253-4f5a-81a6-e96d6d728638","Type":"ContainerDied","Data":"6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed"} Jun 03 19:36:48.214230 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.213895 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a70a94700d5d91c5c64434324c7c2c2bab7a695948e7127bfd184fd980c9bed" Jun 03 19:36:48.216260 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.216233 2578 generic.go:356] "Generic (PLEG): container finished" podID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerID="13eb84b1798da725814bcc81e5a795f39a9fa0e462cd8997a72a72431c847ce3" exitCode=0 Jun 03 19:36:48.216372 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.216318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" event={"ID":"5fad048a-3362-401b-a698-38d8bbbe9e0a","Type":"ContainerDied","Data":"13eb84b1798da725814bcc81e5a795f39a9fa0e462cd8997a72a72431c847ce3"} Jun 03 19:36:48.354254 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.354226 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:48.453639 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.453522 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxvn\" (UniqueName: \"kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn\") pod \"86127117-ff35-4afb-92e5-a5b3b4b78080\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " Jun 03 19:36:48.453639 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.453578 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util\") pod \"86127117-ff35-4afb-92e5-a5b3b4b78080\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " Jun 03 19:36:48.453861 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.453651 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle\") pod \"86127117-ff35-4afb-92e5-a5b3b4b78080\" (UID: \"86127117-ff35-4afb-92e5-a5b3b4b78080\") " Jun 03 19:36:48.454285 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.454256 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle" (OuterVolumeSpecName: "bundle") pod "86127117-ff35-4afb-92e5-a5b3b4b78080" (UID: "86127117-ff35-4afb-92e5-a5b3b4b78080"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:48.455704 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.455671 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn" (OuterVolumeSpecName: "kube-api-access-xvxvn") pod "86127117-ff35-4afb-92e5-a5b3b4b78080" (UID: "86127117-ff35-4afb-92e5-a5b3b4b78080"). InnerVolumeSpecName "kube-api-access-xvxvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:48.461859 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.461795 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util" (OuterVolumeSpecName: "util") pod "86127117-ff35-4afb-92e5-a5b3b4b78080" (UID: "86127117-ff35-4afb-92e5-a5b3b4b78080"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:48.555068 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.555031 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:48.555068 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.555065 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxvn\" (UniqueName: \"kubernetes.io/projected/86127117-ff35-4afb-92e5-a5b3b4b78080-kube-api-access-xvxvn\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:48.555068 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:48.555075 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86127117-ff35-4afb-92e5-a5b3b4b78080-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:49.223362 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.223331 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" Jun 03 19:36:49.223362 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.223355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5" event={"ID":"86127117-ff35-4afb-92e5-a5b3b4b78080","Type":"ContainerDied","Data":"f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46"} Jun 03 19:36:49.223894 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.223401 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f73f42a6e6a93dc9141fed85213a195c3f225f347f37112a3ff4a4a6cf41ca46" Jun 03 19:36:49.358708 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.358679 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:49.462341 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.462298 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util\") pod \"5fad048a-3362-401b-a698-38d8bbbe9e0a\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " Jun 03 19:36:49.462493 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.462404 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v2j4\" (UniqueName: \"kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4\") pod \"5fad048a-3362-401b-a698-38d8bbbe9e0a\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " Jun 03 19:36:49.462493 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.462435 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle\") pod \"5fad048a-3362-401b-a698-38d8bbbe9e0a\" (UID: \"5fad048a-3362-401b-a698-38d8bbbe9e0a\") " Jun 03 19:36:49.463013 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.462987 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle" (OuterVolumeSpecName: "bundle") pod "5fad048a-3362-401b-a698-38d8bbbe9e0a" (UID: "5fad048a-3362-401b-a698-38d8bbbe9e0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:49.464522 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.464497 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4" (OuterVolumeSpecName: "kube-api-access-6v2j4") pod "5fad048a-3362-401b-a698-38d8bbbe9e0a" (UID: "5fad048a-3362-401b-a698-38d8bbbe9e0a"). InnerVolumeSpecName "kube-api-access-6v2j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:36:49.467731 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.467707 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util" (OuterVolumeSpecName: "util") pod "5fad048a-3362-401b-a698-38d8bbbe9e0a" (UID: "5fad048a-3362-401b-a698-38d8bbbe9e0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:36:49.564058 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.564016 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v2j4\" (UniqueName: \"kubernetes.io/projected/5fad048a-3362-401b-a698-38d8bbbe9e0a-kube-api-access-6v2j4\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:49.564058 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.564050 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:49.564058 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:49.564059 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fad048a-3362-401b-a698-38d8bbbe9e0a-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:36:50.230258 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:50.230226 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" Jun 03 19:36:50.230713 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:50.230234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j" event={"ID":"5fad048a-3362-401b-a698-38d8bbbe9e0a","Type":"ContainerDied","Data":"f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126"} Jun 03 19:36:50.230713 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:36:50.230366 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f40d6e78f4250e4b6bff48d633ff51d1609f8ce9d10fc8e4dfa876c84658a126" Jun 03 19:37:00.375858 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.375754 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz"] Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376091 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376103 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376112 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376118 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376125 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376131 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376137 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376144 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376151 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376156 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376163 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376168 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376178 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376183 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376200 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376205 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376211 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376217 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376225 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376230 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376238 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376243 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="util" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376250 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376255 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="pull" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376303 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="845a5d57-31fd-4602-9fb6-98e09384b6dd" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376313 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="86127117-ff35-4afb-92e5-a5b3b4b78080" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376319 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0dbd68-4253-4f5a-81a6-e96d6d728638" containerName="extract" Jun 03 19:37:00.376319 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.376325 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fad048a-3362-401b-a698-38d8bbbe9e0a" containerName="extract" Jun 03 19:37:00.383105 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.383083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.386305 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.386287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngf6h\"" Jun 03 19:37:00.402805 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.402771 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz"] Jun 03 19:37:00.568072 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.568032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9tk\" (UniqueName: \"kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.568252 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.568087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.668653 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.668556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.668813 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.668657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9tk\" (UniqueName: \"kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.668992 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.668970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.678377 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.678348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9tk\" (UniqueName: \"kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.693569 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.693534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:00.836328 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:00.836241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz"] Jun 03 19:37:00.838733 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:37:00.838707 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b361ebe_19c4_4298_b951_7af9f1fafd65.slice/crio-663b925413031e47ddd15dc75fe6af48763436e00b97afd7def96773a0cd21f5 WatchSource:0}: Error finding container 663b925413031e47ddd15dc75fe6af48763436e00b97afd7def96773a0cd21f5: Status 404 returned error can't find the container with id 663b925413031e47ddd15dc75fe6af48763436e00b97afd7def96773a0cd21f5 Jun 03 19:37:01.210747 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.210699 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84b54974bc-62ww5" podUID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" containerName="console" containerID="cri-o://3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2" gracePeriod=15 Jun 03 19:37:01.282384 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.282341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" event={"ID":"9b361ebe-19c4-4298-b951-7af9f1fafd65","Type":"ContainerStarted","Data":"663b925413031e47ddd15dc75fe6af48763436e00b97afd7def96773a0cd21f5"} Jun 03 19:37:01.451130 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.451108 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:37:01.575436 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575400 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575454 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575487 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575520 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575557 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn2vg\" (UniqueName: \"kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575608 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert\") pod \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\" (UID: \"39d41ebe-1a72-45bf-bf70-ba9d4077519e\") " Jun 03 19:37:01.575991 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.575964 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca" (OuterVolumeSpecName: "service-ca") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:01.576092 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.576069 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:01.576148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.576022 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config" (OuterVolumeSpecName: "console-config") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:01.576248 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.576212 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:37:01.578232 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.578192 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:37:01.578461 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.578437 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg" (OuterVolumeSpecName: "kube-api-access-cn2vg") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "kube-api-access-cn2vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:37:01.578651 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.578614 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39d41ebe-1a72-45bf-bf70-ba9d4077519e" (UID: "39d41ebe-1a72-45bf-bf70-ba9d4077519e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:37:01.677242 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677199 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-service-ca\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677242 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677238 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-oauth-config\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677242 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677253 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-trusted-ca-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677508 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677266 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-config\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677508 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677278 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d41ebe-1a72-45bf-bf70-ba9d4077519e-oauth-serving-cert\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677508 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677289 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn2vg\" (UniqueName: \"kubernetes.io/projected/39d41ebe-1a72-45bf-bf70-ba9d4077519e-kube-api-access-cn2vg\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:01.677508 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:01.677301 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d41ebe-1a72-45bf-bf70-ba9d4077519e-console-serving-cert\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:02.289407 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.289364 2578 generic.go:356] "Generic (PLEG): container finished" podID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" containerID="3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2" exitCode=0 Jun 03 19:37:02.289591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.289429 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b54974bc-62ww5" Jun 03 19:37:02.289591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.289459 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b54974bc-62ww5" event={"ID":"39d41ebe-1a72-45bf-bf70-ba9d4077519e","Type":"ContainerDied","Data":"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2"} Jun 03 19:37:02.289591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.289552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b54974bc-62ww5" event={"ID":"39d41ebe-1a72-45bf-bf70-ba9d4077519e","Type":"ContainerDied","Data":"d97ecdcd9b05dd3aaeb2f45c592ca095ef6ead2e0b47c2b1b0b0850cc11d3070"} Jun 03 19:37:02.289591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.289575 2578 scope.go:117] "RemoveContainer" containerID="3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2" Jun 03 19:37:02.299718 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.299692 2578 scope.go:117] "RemoveContainer" containerID="3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2" Jun 03 19:37:02.300137 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:02.300085 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2\": container with ID starting with 3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2 not found: ID does not exist" containerID="3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2" Jun 03 19:37:02.300253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.300148 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2"} err="failed to get container status \"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2\": rpc error: code = NotFound desc = could not find container \"3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2\": container with ID starting with 3a3fd8b55707ffdc14c85d4a655c628fced109985375991843e8c2f58f4e6bb2 not found: ID does not exist" Jun 03 19:37:02.319213 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.319175 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:37:02.330132 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:02.330100 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b54974bc-62ww5"] Jun 03 19:37:03.016947 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.016917 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zkffc"] Jun 03 19:37:03.017276 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.017232 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" containerName="console" Jun 03 19:37:03.017276 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.017244 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" containerName="console" Jun 03 19:37:03.017356 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.017309 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" containerName="console" Jun 03 19:37:03.022053 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.022037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:03.027525 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.027500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zz9f4\"" Jun 03 19:37:03.040749 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.040716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zkffc"] Jun 03 19:37:03.191624 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.191590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z6g4\" (UniqueName: \"kubernetes.io/projected/eaeb6ea0-70d7-4929-b714-7aaf1ae17971-kube-api-access-7z6g4\") pod \"authorino-operator-75cc8d5cb7-zkffc\" (UID: \"eaeb6ea0-70d7-4929-b714-7aaf1ae17971\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:03.292562 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.292076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z6g4\" (UniqueName: \"kubernetes.io/projected/eaeb6ea0-70d7-4929-b714-7aaf1ae17971-kube-api-access-7z6g4\") pod \"authorino-operator-75cc8d5cb7-zkffc\" (UID: \"eaeb6ea0-70d7-4929-b714-7aaf1ae17971\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:03.304532 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.304444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z6g4\" (UniqueName: \"kubernetes.io/projected/eaeb6ea0-70d7-4929-b714-7aaf1ae17971-kube-api-access-7z6g4\") pod \"authorino-operator-75cc8d5cb7-zkffc\" (UID: \"eaeb6ea0-70d7-4929-b714-7aaf1ae17971\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:03.332225 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.332181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:03.471942 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:03.471900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zkffc"] Jun 03 19:37:03.475351 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:37:03.475324 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaeb6ea0_70d7_4929_b714_7aaf1ae17971.slice/crio-42d3bb956c6193815a19579ed2a36ea023aea282270147e4a4c9fdfce94cc268 WatchSource:0}: Error finding container 42d3bb956c6193815a19579ed2a36ea023aea282270147e4a4c9fdfce94cc268: Status 404 returned error can't find the container with id 42d3bb956c6193815a19579ed2a36ea023aea282270147e4a4c9fdfce94cc268 Jun 03 19:37:04.157680 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:04.157640 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d41ebe-1a72-45bf-bf70-ba9d4077519e" path="/var/lib/kubelet/pods/39d41ebe-1a72-45bf-bf70-ba9d4077519e/volumes" Jun 03 19:37:04.303582 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:04.303543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" event={"ID":"eaeb6ea0-70d7-4929-b714-7aaf1ae17971","Type":"ContainerStarted","Data":"42d3bb956c6193815a19579ed2a36ea023aea282270147e4a4c9fdfce94cc268"} Jun 03 19:37:07.323116 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.323068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" event={"ID":"9b361ebe-19c4-4298-b951-7af9f1fafd65","Type":"ContainerStarted","Data":"6039b54a0272e43ed02a4aec50f2c18da8905d25142f5bee627a9d95eb1eb248"} Jun 03 19:37:07.323577 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.323386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:07.325184 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.325152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" event={"ID":"eaeb6ea0-70d7-4929-b714-7aaf1ae17971","Type":"ContainerStarted","Data":"c57a16d9d0d7fd5e5ad8892adc1b527c776f7f0da564255ea0556e4645812d2a"} Jun 03 19:37:07.325348 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.325279 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:07.348031 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.347975 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" podStartSLOduration=1.4209013160000001 podStartE2EDuration="7.347954811s" totalImagesPullingTime="5.927053495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:07.345383978 +0000 UTC m=+445.719501012" watchObservedRunningTime="2026-06-03 19:37:07.347954811 +0000 UTC m=+445.722071847" Jun 03 19:37:07.370256 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:07.370201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" podStartSLOduration=2.03939889 podStartE2EDuration="5.370162963s" totalImagesPullingTime="3.330764073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:07.36941709 +0000 UTC m=+445.743534128" watchObservedRunningTime="2026-06-03 19:37:07.370162963 +0000 UTC m=+445.744280000" Jun 03 19:37:09.746912 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.746876 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24"] Jun 03 19:37:09.750561 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.750540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.753494 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.753445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 19:37:09.753633 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.753524 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x7vrp\"" Jun 03 19:37:09.753721 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.753707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 19:37:09.761611 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.761583 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24"] Jun 03 19:37:09.852427 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.852391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwx55\" (UniqueName: \"kubernetes.io/projected/94ea6280-871c-4b9d-b88e-fe68cb2b5638-kube-api-access-vwx55\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.852647 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.852480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.852647 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.852509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94ea6280-871c-4b9d-b88e-fe68cb2b5638-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.953030 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.952987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.953030 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.953036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94ea6280-871c-4b9d-b88e-fe68cb2b5638-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.953292 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.953069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwx55\" (UniqueName: \"kubernetes.io/projected/94ea6280-871c-4b9d-b88e-fe68cb2b5638-kube-api-access-vwx55\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.953292 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:09.953137 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 03 19:37:09.953292 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:09.953208 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert podName:94ea6280-871c-4b9d-b88e-fe68cb2b5638 nodeName:}" failed. No retries permitted until 2026-06-03 19:37:10.453190514 +0000 UTC m=+448.827307534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ghg24" (UID: "94ea6280-871c-4b9d-b88e-fe68cb2b5638") : secret "plugin-serving-cert" not found Jun 03 19:37:09.953702 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.953678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94ea6280-871c-4b9d-b88e-fe68cb2b5638-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:09.964685 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:09.964656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwx55\" (UniqueName: \"kubernetes.io/projected/94ea6280-871c-4b9d-b88e-fe68cb2b5638-kube-api-access-vwx55\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:10.457969 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:10.457924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:10.460404 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:10.460382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ea6280-871c-4b9d-b88e-fe68cb2b5638-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ghg24\" (UID: \"94ea6280-871c-4b9d-b88e-fe68cb2b5638\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:10.660252 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:10.660209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" Jun 03 19:37:10.822940 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:10.822913 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24"] Jun 03 19:37:10.824458 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:37:10.824429 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ea6280_871c_4b9d_b88e_fe68cb2b5638.slice/crio-955507c08968fa53f3bec074859abd1610d2b2aaa1989f4a7779d9117616a5e0 WatchSource:0}: Error finding container 955507c08968fa53f3bec074859abd1610d2b2aaa1989f4a7779d9117616a5e0: Status 404 returned error can't find the container with id 955507c08968fa53f3bec074859abd1610d2b2aaa1989f4a7779d9117616a5e0 Jun 03 19:37:11.350474 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:11.350438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" event={"ID":"94ea6280-871c-4b9d-b88e-fe68cb2b5638","Type":"ContainerStarted","Data":"955507c08968fa53f3bec074859abd1610d2b2aaa1989f4a7779d9117616a5e0"} Jun 03 19:37:18.333872 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:18.333799 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:18.334333 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:18.333993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zkffc" Jun 03 19:37:20.226209 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.226165 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz"] Jun 03 19:37:20.226702 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.226433 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" containerName="manager" containerID="cri-o://6039b54a0272e43ed02a4aec50f2c18da8905d25142f5bee627a9d95eb1eb248" gracePeriod=2 Jun 03 19:37:20.229074 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:20.229034 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:20.229561 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.229522 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz"] Jun 03 19:37:20.405988 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.405956 2578 generic.go:356] "Generic (PLEG): container finished" podID="9b361ebe-19c4-4298-b951-7af9f1fafd65" containerID="6039b54a0272e43ed02a4aec50f2c18da8905d25142f5bee627a9d95eb1eb248" exitCode=0 Jun 03 19:37:20.486222 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.486159 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:20.488502 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:20.488475 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:20.549140 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.549106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume\") pod \"9b361ebe-19c4-4298-b951-7af9f1fafd65\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " Jun 03 19:37:20.549274 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.549177 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp9tk\" (UniqueName: \"kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk\") pod \"9b361ebe-19c4-4298-b951-7af9f1fafd65\" (UID: \"9b361ebe-19c4-4298-b951-7af9f1fafd65\") " Jun 03 19:37:20.549637 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.549608 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b361ebe-19c4-4298-b951-7af9f1fafd65" (UID: "9b361ebe-19c4-4298-b951-7af9f1fafd65"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:37:20.551262 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.551233 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk" (OuterVolumeSpecName: "kube-api-access-bp9tk") pod "9b361ebe-19c4-4298-b951-7af9f1fafd65" (UID: "9b361ebe-19c4-4298-b951-7af9f1fafd65"). InnerVolumeSpecName "kube-api-access-bp9tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:37:20.650121 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.650084 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b361ebe-19c4-4298-b951-7af9f1fafd65-extensions-socket-volume\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:20.650121 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:20.650112 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp9tk\" (UniqueName: \"kubernetes.io/projected/9b361ebe-19c4-4298-b951-7af9f1fafd65-kube-api-access-bp9tk\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:37:21.413600 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.413538 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:21.413600 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.413585 2578 scope.go:117] "RemoveContainer" containerID="6039b54a0272e43ed02a4aec50f2c18da8905d25142f5bee627a9d95eb1eb248" Jun 03 19:37:21.417361 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:21.417326 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:21.429114 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:21.429084 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:21.435905 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.435870 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:37:21.436253 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.436238 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" containerName="manager" Jun 03 19:37:21.436310 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.436255 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" containerName="manager" Jun 03 19:37:21.436353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.436339 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" containerName="manager" Jun 03 19:37:21.442732 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.442706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.446165 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:21.446131 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:21.447002 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.446978 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngf6h\"" Jun 03 19:37:21.460122 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.460092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:37:21.559157 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.559117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.559361 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.559276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qbp\" (UniqueName: \"kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.660087 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.660039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qbp\" (UniqueName: \"kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.660281 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.660131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.660617 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.660583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.671191 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.671124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qbp\" (UniqueName: \"kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp\") pod \"kuadrant-operator-controller-manager-86878c769f-dpx2f\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:21.755404 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:21.755358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:22.155511 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:37:22.155472 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-blvfz\" is forbidden: User \"system:node:ip-10-0-140-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-28.ec2.internal' and this object" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-blvfz" Jun 03 19:37:22.157188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:22.157157 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b361ebe-19c4-4298-b951-7af9f1fafd65" path="/var/lib/kubelet/pods/9b361ebe-19c4-4298-b951-7af9f1fafd65/volumes" Jun 03 19:37:35.702679 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:35.702648 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:37:35.703652 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:37:35.703623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bff7fd_1b59_400a_9c8c_06068be2be6d.slice/crio-31e84cb0d96926eee09001c971960d1fb07d876353491cda07bceb2fdf82e642 WatchSource:0}: Error finding container 31e84cb0d96926eee09001c971960d1fb07d876353491cda07bceb2fdf82e642: Status 404 returned error can't find the container with id 31e84cb0d96926eee09001c971960d1fb07d876353491cda07bceb2fdf82e642 Jun 03 19:37:36.499391 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.499357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" event={"ID":"48bff7fd-1b59-400a-9c8c-06068be2be6d","Type":"ContainerStarted","Data":"3e9030921d209a9dba2110afd772261965988848e78b4b745e8d0b3cf70eaff4"} Jun 03 19:37:36.499625 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.499411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" event={"ID":"48bff7fd-1b59-400a-9c8c-06068be2be6d","Type":"ContainerStarted","Data":"31e84cb0d96926eee09001c971960d1fb07d876353491cda07bceb2fdf82e642"} Jun 03 19:37:36.499625 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.499474 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:37:36.501806 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.501780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" event={"ID":"94ea6280-871c-4b9d-b88e-fe68cb2b5638","Type":"ContainerStarted","Data":"7f32b097f672878816b932065c24ea2ddf14c1e83075a365c50882c486d611c3"} Jun 03 19:37:36.527973 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.527894 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" podStartSLOduration=15.527875207 podStartE2EDuration="15.527875207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:36.526050341 +0000 UTC m=+474.900167385" watchObservedRunningTime="2026-06-03 19:37:36.527875207 +0000 UTC m=+474.901992248" Jun 03 19:37:36.557029 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:36.556960 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ghg24" podStartSLOduration=2.745047935 podStartE2EDuration="27.55693844s" totalImagesPullingTime="24.811890505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:37:36.555415548 +0000 UTC m=+474.929532585" watchObservedRunningTime="2026-06-03 19:37:36.55693844 +0000 UTC m=+474.931055478" Jun 03 19:37:47.512832 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:37:47.512796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:39:23.326980 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.326942 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt"] Jun 03 19:39:23.330446 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.330426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.333188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.333168 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 19:39:23.334206 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.334193 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 19:39:23.334264 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.334203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7dm82\"" Jun 03 19:39:23.340299 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.340272 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt"] Jun 03 19:39:23.433106 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.433055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.433307 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.433169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.433307 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.433194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdbn\" (UniqueName: \"kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.533989 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.533946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.533989 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.533992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdbn\" (UniqueName: \"kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.534257 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.534076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.534361 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.534338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.534449 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.534430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.542807 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.542773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdbn\" (UniqueName: \"kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.640261 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.640176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:23.781401 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:23.781366 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt"] Jun 03 19:39:23.783162 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:39:23.783132 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba5e8ab_16ef_445e_b35c_2600f1cc89a4.slice/crio-b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66 WatchSource:0}: Error finding container b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66: Status 404 returned error can't find the container with id b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66 Jun 03 19:39:24.034213 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:24.034178 2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerID="1e83167ebe18d2d12530dbfcb0d7f2198ac6b180ca0d9930b55cdc2926d7a8d2" exitCode=0 Jun 03 19:39:24.034405 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:24.034265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" event={"ID":"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4","Type":"ContainerDied","Data":"1e83167ebe18d2d12530dbfcb0d7f2198ac6b180ca0d9930b55cdc2926d7a8d2"} Jun 03 19:39:24.034405 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:24.034360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" event={"ID":"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4","Type":"ContainerStarted","Data":"b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66"} Jun 03 19:39:25.041433 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:25.041397 2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerID="5f367ae0e7177f18b01fb2804e4f6d50fd0f7c38a0dd1f1ebce1e18850934bf4" exitCode=0 Jun 03 19:39:25.041858 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:25.041485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" event={"ID":"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4","Type":"ContainerDied","Data":"5f367ae0e7177f18b01fb2804e4f6d50fd0f7c38a0dd1f1ebce1e18850934bf4"} Jun 03 19:39:26.048676 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:26.048636 2578 generic.go:356] "Generic (PLEG): container finished" podID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerID="c7cf1fdb561d1c0b5833ddfc0d7a3021ef5fd301562c22a9a39853777d38b708" exitCode=0 Jun 03 19:39:26.049085 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:26.048728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" event={"ID":"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4","Type":"ContainerDied","Data":"c7cf1fdb561d1c0b5833ddfc0d7a3021ef5fd301562c22a9a39853777d38b708"} Jun 03 19:39:27.196074 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.196039 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:27.278033 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.277995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle\") pod \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " Jun 03 19:39:27.278293 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.278078 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wdbn\" (UniqueName: \"kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn\") pod \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " Jun 03 19:39:27.278293 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.278134 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util\") pod \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\" (UID: \"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4\") " Jun 03 19:39:27.278612 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.278579 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle" (OuterVolumeSpecName: "bundle") pod "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" (UID: "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:27.280239 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.280215 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn" (OuterVolumeSpecName: "kube-api-access-5wdbn") pod "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" (UID: "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4"). InnerVolumeSpecName "kube-api-access-5wdbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:39:27.284478 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.284448 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util" (OuterVolumeSpecName: "util") pod "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" (UID: "1ba5e8ab-16ef-445e-b35c-2600f1cc89a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:39:27.379384 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.379290 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-bundle\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:39:27.379384 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.379321 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wdbn\" (UniqueName: \"kubernetes.io/projected/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-kube-api-access-5wdbn\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:39:27.379384 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:27.379333 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ba5e8ab-16ef-445e-b35c-2600f1cc89a4-util\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:39:28.060567 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:28.060529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" event={"ID":"1ba5e8ab-16ef-445e-b35c-2600f1cc89a4","Type":"ContainerDied","Data":"b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66"} Jun 03 19:39:28.060736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:28.060581 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b690b61ad00993ae44a288315c613c2024a76c93e0bb63b3e6e1a0621468cc66" Jun 03 19:39:28.060736 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:28.060547 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707b4tt" Jun 03 19:39:42.129706 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:42.129679 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:39:42.130367 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:42.130349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:39:42.136304 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:42.136278 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:39:42.136779 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:42.136761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:39:46.498718 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.498680 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499057 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="pull" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499072 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="pull" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499082 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="util" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499088 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="util" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499113 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="extract" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499119 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="extract" Jun 03 19:39:46.499188 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.499174 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ba5e8ab-16ef-445e-b35c-2600f1cc89a4" containerName="extract" Jun 03 19:39:46.502324 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.502307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:46.504848 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.504822 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:39:46.504987 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.504901 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 19:39:46.504987 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.504905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:39:46.505863 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.505820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k8w6t\"" Jun 03 19:39:46.512591 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.512569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:39:46.545717 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.545668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jt9v\" (UniqueName: \"kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v\") pod \"maas-keycloak-0\" (UID: \"0b538244-7b96-4b68-82c3-c34d3b4e9c39\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:46.646559 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.646507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jt9v\" (UniqueName: \"kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v\") pod \"maas-keycloak-0\" (UID: \"0b538244-7b96-4b68-82c3-c34d3b4e9c39\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:46.656663 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.656634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jt9v\" (UniqueName: \"kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v\") pod \"maas-keycloak-0\" (UID: \"0b538244-7b96-4b68-82c3-c34d3b4e9c39\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:46.813752 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.813711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:46.951638 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:46.951610 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:39:46.954315 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:39:46.954290 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b538244_7b96_4b68_82c3_c34d3b4e9c39.slice/crio-fc886f9fb9eaeb095bfb2357fb77a303eaf2f1fc4aaf60b7d83925be755dee58 WatchSource:0}: Error finding container fc886f9fb9eaeb095bfb2357fb77a303eaf2f1fc4aaf60b7d83925be755dee58: Status 404 returned error can't find the container with id fc886f9fb9eaeb095bfb2357fb77a303eaf2f1fc4aaf60b7d83925be755dee58 Jun 03 19:39:47.156828 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:47.156737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b538244-7b96-4b68-82c3-c34d3b4e9c39","Type":"ContainerStarted","Data":"fc886f9fb9eaeb095bfb2357fb77a303eaf2f1fc4aaf60b7d83925be755dee58"} Jun 03 19:39:52.193375 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:52.193335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b538244-7b96-4b68-82c3-c34d3b4e9c39","Type":"ContainerStarted","Data":"e03c25371cbe2d8d9ea087ea20e0b378e9ec239497aa133e25b3f38e336b2da9"} Jun 03 19:39:52.213237 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:52.213186 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.669029492 podStartE2EDuration="6.213169174s" totalImagesPullingTime="4.544139682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:39:52.212899927 +0000 UTC m=+610.587016968" watchObservedRunningTime="2026-06-03 19:39:52.213169174 +0000 UTC m=+610.587286210" Jun 03 19:39:52.814393 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:52.814336 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:52.816750 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:52.816705 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:53.814496 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:53.814439 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:54.815266 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:54.815215 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:55.815067 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:55.814950 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:56.814501 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:56.814457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:39:56.815123 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:56.814499 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:57.814504 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:57.814451 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:58.814403 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:58.814346 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:39:59.814370 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:39:59.814315 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:00.814403 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:00.814356 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:01.815020 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:01.814961 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:02.814446 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:02.814381 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:03.814331 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:03.814280 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:04.814418 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:04.814372 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 03 19:40:05.945696 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:05.945651 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 19:40:05.960810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:05.960757 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:40:15.952896 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:15.952835 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:40:17.342032 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.341997 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:40:17.349386 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.349359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.352571 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.352540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:40:17.378060 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.378027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:40:17.444396 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.444354 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:40:17.450198 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.450163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-config-file\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.450198 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.450199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mdzt\" (UniqueName: \"kubernetes.io/projected/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-kube-api-access-4mdzt\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.550925 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.550883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-config-file\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.550925 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.550923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mdzt\" (UniqueName: \"kubernetes.io/projected/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-kube-api-access-4mdzt\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.551592 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.551567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-config-file\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.561381 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.561345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mdzt\" (UniqueName: \"kubernetes.io/projected/77590d4a-38ed-4b17-a77f-2cd5306eaf6e-kube-api-access-4mdzt\") pod \"limitador-limitador-54d6d988d5-vksb7\" (UID: \"77590d4a-38ed-4b17-a77f-2cd5306eaf6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.660687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.660595 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:17.810184 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.810146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:40:17.811464 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:40:17.811437 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77590d4a_38ed_4b17_a77f_2cd5306eaf6e.slice/crio-80548d15a0fa84fe7bce36b5eb2fc2c6cf96e473bd66cfb8f29efac4e39da75c WatchSource:0}: Error finding container 80548d15a0fa84fe7bce36b5eb2fc2c6cf96e473bd66cfb8f29efac4e39da75c: Status 404 returned error can't find the container with id 80548d15a0fa84fe7bce36b5eb2fc2c6cf96e473bd66cfb8f29efac4e39da75c Jun 03 19:40:17.813358 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:17.813342 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:40:18.366503 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:18.366458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" event={"ID":"77590d4a-38ed-4b17-a77f-2cd5306eaf6e","Type":"ContainerStarted","Data":"80548d15a0fa84fe7bce36b5eb2fc2c6cf96e473bd66cfb8f29efac4e39da75c"} Jun 03 19:40:20.380539 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:20.380497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" event={"ID":"77590d4a-38ed-4b17-a77f-2cd5306eaf6e","Type":"ContainerStarted","Data":"3f9390d299bc8f94150b1a8bf3f741fd77451c0ccde12489cee3c554c71ba7e8"} Jun 03 19:40:20.381058 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:20.380564 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:40:20.398902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:20.398830 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" podStartSLOduration=1.060663774 podStartE2EDuration="3.398814049s" totalImagesPullingTime="2.338150275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:20.397119582 +0000 UTC m=+638.771236621" watchObservedRunningTime="2026-06-03 19:40:20.398814049 +0000 UTC m=+638.772931089" Jun 03 19:40:22.539521 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.539480 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:40:22.541910 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.541891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.545300 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.545273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wl4tz\"" Jun 03 19:40:22.545439 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.545276 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 19:40:22.550665 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.550642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:40:22.599380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.599335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.599552 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.599463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp4pb\" (UniqueName: \"kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.700430 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.700390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp4pb\" (UniqueName: \"kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.700603 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.700467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.702908 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.702880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.709395 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.709366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp4pb\" (UniqueName: \"kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb\") pod \"authorino-5bb688c8f8-lnbrl\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.852340 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.852301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:40:22.992810 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:22.992784 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:40:22.994879 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:40:22.994831 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca7b061_2aa3_44e7_b8c4_0fcc548f0f0c.slice/crio-08d9f435a0c8627e2c9dab80bcc76b6729c1c4a7a91a4dc4613007494a4f4e21 WatchSource:0}: Error finding container 08d9f435a0c8627e2c9dab80bcc76b6729c1c4a7a91a4dc4613007494a4f4e21: Status 404 returned error can't find the container with id 08d9f435a0c8627e2c9dab80bcc76b6729c1c4a7a91a4dc4613007494a4f4e21 Jun 03 19:40:23.399871 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:23.399799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" event={"ID":"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c","Type":"ContainerStarted","Data":"08d9f435a0c8627e2c9dab80bcc76b6729c1c4a7a91a4dc4613007494a4f4e21"} Jun 03 19:40:26.420482 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:26.420446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" event={"ID":"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c","Type":"ContainerStarted","Data":"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66"} Jun 03 19:40:26.440000 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:26.439941 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" podStartSLOduration=1.702553692 podStartE2EDuration="4.439925074s" totalImagesPullingTime="2.737371382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:40:26.437295875 +0000 UTC m=+644.811412912" watchObservedRunningTime="2026-06-03 19:40:26.439925074 +0000 UTC m=+644.814042110" Jun 03 19:40:31.387083 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:40:31.387046 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vksb7" Jun 03 19:41:05.298019 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:05.297976 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:41:15.183998 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:15.183961 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:15.184459 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:15.184164 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" containerID="cri-o://e03c25371cbe2d8d9ea087ea20e0b378e9ec239497aa133e25b3f38e336b2da9" gracePeriod=30 Jun 03 19:41:15.950133 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:15.950082 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:41:16.684687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:16.684655 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerID="e03c25371cbe2d8d9ea087ea20e0b378e9ec239497aa133e25b3f38e336b2da9" exitCode=143 Jun 03 19:41:16.685101 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:16.684727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b538244-7b96-4b68-82c3-c34d3b4e9c39","Type":"ContainerDied","Data":"e03c25371cbe2d8d9ea087ea20e0b378e9ec239497aa133e25b3f38e336b2da9"} Jun 03 19:41:17.235704 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.235677 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.284893 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.284834 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jt9v\" (UniqueName: \"kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v\") pod \"0b538244-7b96-4b68-82c3-c34d3b4e9c39\" (UID: \"0b538244-7b96-4b68-82c3-c34d3b4e9c39\") " Jun 03 19:41:17.287174 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.287135 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v" (OuterVolumeSpecName: "kube-api-access-7jt9v") pod "0b538244-7b96-4b68-82c3-c34d3b4e9c39" (UID: "0b538244-7b96-4b68-82c3-c34d3b4e9c39"). InnerVolumeSpecName "kube-api-access-7jt9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:41:17.386362 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.386262 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jt9v\" (UniqueName: \"kubernetes.io/projected/0b538244-7b96-4b68-82c3-c34d3b4e9c39-kube-api-access-7jt9v\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:41:17.692421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.692333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0b538244-7b96-4b68-82c3-c34d3b4e9c39","Type":"ContainerDied","Data":"fc886f9fb9eaeb095bfb2357fb77a303eaf2f1fc4aaf60b7d83925be755dee58"} Jun 03 19:41:17.692421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.692390 2578 scope.go:117] "RemoveContainer" containerID="e03c25371cbe2d8d9ea087ea20e0b378e9ec239497aa133e25b3f38e336b2da9" Jun 03 19:41:17.692957 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.692345 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.714346 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.714309 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:17.718051 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.718020 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:17.739870 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.739818 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:17.740196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.740181 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" Jun 03 19:41:17.740196 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.740197 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" Jun 03 19:41:17.740306 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.740250 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" containerName="keycloak" Jun 03 19:41:17.742914 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.742898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.745646 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.745620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:41:17.745646 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.745651 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k8w6t\"" Jun 03 19:41:17.745825 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.745683 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:41:17.745825 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.745620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 19:41:17.746999 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.746979 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 19:41:17.757781 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.757752 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:17.788868 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.788809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4eb2772b-9569-44a7-8f7d-b097a0ec9007-test-realms\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.789060 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.788875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/4eb2772b-9569-44a7-8f7d-b097a0ec9007-kube-api-access-xsxsf\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.889450 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.889409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4eb2772b-9569-44a7-8f7d-b097a0ec9007-test-realms\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.889450 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.889446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/4eb2772b-9569-44a7-8f7d-b097a0ec9007-kube-api-access-xsxsf\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.890148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.890127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4eb2772b-9569-44a7-8f7d-b097a0ec9007-test-realms\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:17.899167 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:17.899130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxsf\" (UniqueName: \"kubernetes.io/projected/4eb2772b-9569-44a7-8f7d-b097a0ec9007-kube-api-access-xsxsf\") pod \"maas-keycloak-0\" (UID: \"4eb2772b-9569-44a7-8f7d-b097a0ec9007\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:18.055817 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.055778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:18.158942 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.158906 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b538244-7b96-4b68-82c3-c34d3b4e9c39" path="/var/lib/kubelet/pods/0b538244-7b96-4b68-82c3-c34d3b4e9c39/volumes" Jun 03 19:41:18.197906 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.197879 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:41:18.199707 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:41:18.199681 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb2772b_9569_44a7_8f7d_b097a0ec9007.slice/crio-62dbaa0874d6c66ab0950ed717573b962a44e40d77eb716c7912573649dd9151 WatchSource:0}: Error finding container 62dbaa0874d6c66ab0950ed717573b962a44e40d77eb716c7912573649dd9151: Status 404 returned error can't find the container with id 62dbaa0874d6c66ab0950ed717573b962a44e40d77eb716c7912573649dd9151 Jun 03 19:41:18.701087 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.701052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4eb2772b-9569-44a7-8f7d-b097a0ec9007","Type":"ContainerStarted","Data":"743cb5993d1cd238e5fb3bd0bc4fd4d2e9845e5358bc09fa23cbfdc6bba20f17"} Jun 03 19:41:18.701450 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.701101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4eb2772b-9569-44a7-8f7d-b097a0ec9007","Type":"ContainerStarted","Data":"62dbaa0874d6c66ab0950ed717573b962a44e40d77eb716c7912573649dd9151"} Jun 03 19:41:18.723471 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:18.723403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.361134514 podStartE2EDuration="1.723387109s" totalImagesPullingTime="362.252595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:18.720575398 +0000 UTC m=+697.094692434" watchObservedRunningTime="2026-06-03 19:41:18.723387109 +0000 UTC m=+697.097504146" Jun 03 19:41:19.056918 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:19.056873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:19.058705 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:19.058669 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:20.056564 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:20.056514 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:21.056723 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:21.056671 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:22.057001 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:22.056931 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:23.056353 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:23.056299 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:24.056371 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:24.056312 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:25.056760 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:25.056696 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:26.056489 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:26.056431 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:27.057156 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:27.057109 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:28.056279 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:28.056237 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:28.056635 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:28.056600 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:29.057341 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:29.057279 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:30.056367 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:30.056309 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:31.056636 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:31.056578 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 03 19:41:32.171960 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:32.171905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 19:41:32.190727 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:32.190672 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:41:42.176902 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:42.176835 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4eb2772b-9569-44a7-8f7d-b097a0ec9007" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:41:52.178247 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:41:52.178193 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:42:04.455623 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.455581 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:42:04.456039 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.455831 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" podUID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" containerName="authorino" containerID="cri-o://57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66" gracePeriod=30 Jun 03 19:42:04.730915 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.730885 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:42:04.829476 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.829445 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert\") pod \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " Jun 03 19:42:04.829645 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.829517 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp4pb\" (UniqueName: \"kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb\") pod \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\" (UID: \"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c\") " Jun 03 19:42:04.831568 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.831537 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb" (OuterVolumeSpecName: "kube-api-access-bp4pb") pod "8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" (UID: "8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c"). InnerVolumeSpecName "kube-api-access-bp4pb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:42:04.841203 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.841172 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" (UID: "8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:42:04.930361 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.930323 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-tls-cert\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:42:04.930361 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.930357 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp4pb\" (UniqueName: \"kubernetes.io/projected/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c-kube-api-access-bp4pb\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:42:04.998640 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.998552 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" containerID="57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66" exitCode=0 Jun 03 19:42:04.998640 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.998596 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" Jun 03 19:42:04.998819 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.998644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" event={"ID":"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c","Type":"ContainerDied","Data":"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66"} Jun 03 19:42:04.998819 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.998683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb688c8f8-lnbrl" event={"ID":"8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c","Type":"ContainerDied","Data":"08d9f435a0c8627e2c9dab80bcc76b6729c1c4a7a91a4dc4613007494a4f4e21"} Jun 03 19:42:04.998819 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:04.998700 2578 scope.go:117] "RemoveContainer" containerID="57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66" Jun 03 19:42:05.007823 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:05.007802 2578 scope.go:117] "RemoveContainer" containerID="57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66" Jun 03 19:42:05.008121 ip-10-0-140-28 kubenswrapper[2578]: E0603 19:42:05.008102 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66\": container with ID starting with 57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66 not found: ID does not exist" containerID="57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66" Jun 03 19:42:05.008177 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:05.008130 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66"} err="failed to get container status \"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66\": rpc error: code = NotFound desc = could not find container \"57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66\": container with ID starting with 57cef1110fd4dcc70a2786ca10f38262a7f22e0909528335a461e16972b74b66 not found: ID does not exist" Jun 03 19:42:05.019756 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:05.019725 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:42:05.025668 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:05.025638 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bb688c8f8-lnbrl"] Jun 03 19:42:06.156511 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:06.156475 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" path="/var/lib/kubelet/pods/8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c/volumes" Jun 03 19:42:29.575161 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:29.575117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:42:35.280751 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:35.280715 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:42:51.080339 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:42:51.080301 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:43:10.485175 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:10.485140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:43:16.589095 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:16.589057 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:43:26.842796 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.842756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd"] Jun 03 19:43:26.843308 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.843291 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" containerName="authorino" Jun 03 19:43:26.843380 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.843311 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" containerName="authorino" Jun 03 19:43:26.843437 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.843425 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca7b061-2aa3-44e7-b8c4-0fcc548f0f0c" containerName="authorino" Jun 03 19:43:26.847076 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.847049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.849658 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.849632 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:43:26.850581 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.850561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d5d5j\"" Jun 03 19:43:26.850715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.850610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:43:26.850715 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.850632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 19:43:26.854894 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.854865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd"] Jun 03 19:43:26.959794 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.959755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw2tf\" (UniqueName: \"kubernetes.io/projected/db4c4f74-5479-4ef6-a19e-3aed0e378199-kube-api-access-sw2tf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.960019 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.959800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db4c4f74-5479-4ef6-a19e-3aed0e378199-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.960019 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.959916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.960019 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.959964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.960195 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.960052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:26.960195 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:26.960128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061183 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw2tf\" (UniqueName: \"kubernetes.io/projected/db4c4f74-5479-4ef6-a19e-3aed0e378199-kube-api-access-sw2tf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061383 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db4c4f74-5479-4ef6-a19e-3aed0e378199-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061648 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061648 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.061758 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.061651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.063563 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.063544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db4c4f74-5479-4ef6-a19e-3aed0e378199-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.063958 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.063939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db4c4f74-5479-4ef6-a19e-3aed0e378199-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.072443 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.072416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw2tf\" (UniqueName: \"kubernetes.io/projected/db4c4f74-5479-4ef6-a19e-3aed0e378199-kube-api-access-sw2tf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-27tjd\" (UID: \"db4c4f74-5479-4ef6-a19e-3aed0e378199\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.159560 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.159460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:27.301595 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.301567 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd"] Jun 03 19:43:27.303255 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:43:27.303228 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4c4f74_5479_4ef6_a19e_3aed0e378199.slice/crio-ee7c815be777ff1ffd94478047eefb983a488b320afef483bc378d6c69ddde6c WatchSource:0}: Error finding container ee7c815be777ff1ffd94478047eefb983a488b320afef483bc378d6c69ddde6c: Status 404 returned error can't find the container with id ee7c815be777ff1ffd94478047eefb983a488b320afef483bc378d6c69ddde6c Jun 03 19:43:27.420216 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:27.420130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" event={"ID":"db4c4f74-5479-4ef6-a19e-3aed0e378199","Type":"ContainerStarted","Data":"ee7c815be777ff1ffd94478047eefb983a488b320afef483bc378d6c69ddde6c"} Jun 03 19:43:29.118325 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:29.118280 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:43:31.447233 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:31.447196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" event={"ID":"db4c4f74-5479-4ef6-a19e-3aed0e378199","Type":"ContainerStarted","Data":"31be59c02e5f07be3dca4f15a043be9995e6f09c8c0a78a4296afb1be50496eb"} Jun 03 19:43:32.453792 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:32.453703 2578 generic.go:356] "Generic (PLEG): container finished" podID="db4c4f74-5479-4ef6-a19e-3aed0e378199" containerID="31be59c02e5f07be3dca4f15a043be9995e6f09c8c0a78a4296afb1be50496eb" exitCode=0 Jun 03 19:43:32.454181 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:32.453802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" event={"ID":"db4c4f74-5479-4ef6-a19e-3aed0e378199","Type":"ContainerDied","Data":"31be59c02e5f07be3dca4f15a043be9995e6f09c8c0a78a4296afb1be50496eb"} Jun 03 19:43:34.466433 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:34.466390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" event={"ID":"db4c4f74-5479-4ef6-a19e-3aed0e378199","Type":"ContainerStarted","Data":"5c0128ad01ebdba700b5c18c86777662b02f89164091b2922607eccff5834ede"} Jun 03 19:43:34.485070 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:34.485000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" podStartSLOduration=2.623265386 podStartE2EDuration="8.484983875s" totalImagesPullingTime="4.528820249s" totalInitContainerRuntime="1.33289824s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:34.484700852 +0000 UTC m=+832.858817911" watchObservedRunningTime="2026-06-03 19:43:34.484983875 +0000 UTC m=+832.859100911" Jun 03 19:43:37.160126 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:37.160078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:37.160580 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:37.160149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:37.173290 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:37.173257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:43:37.494277 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:43:37.494189 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-27tjd" Jun 03 19:44:42.173784 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:44:42.173682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:44:42.174983 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:44:42.174958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:44:42.182824 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:44:42.182792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:44:42.183928 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:44:42.183905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:44:58.387820 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:44:58.387782 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:45:08.898910 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:45:08.898869 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:45:17.990052 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:45:17.990013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:45:27.287081 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:45:27.287038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:45:37.083433 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:45:37.083390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:45:47.398669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:45:47.398625 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:46:18.880805 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:46:18.880756 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:46:26.689250 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:46:26.689210 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:47:02.598506 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:47:02.598472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:47:18.694634 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:47:18.694598 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:47:56.093492 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:47:56.093411 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:48:12.778881 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:48:12.778828 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:48:27.688723 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:48:27.688682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:48:44.089687 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:48:44.089644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:49:42.210118 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:49:42.210087 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:49:42.213765 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:49:42.213737 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:49:42.217193 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:49:42.217172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:49:42.220572 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:49:42.220557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:49:51.283276 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:49:51.283240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:50:00.588148 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:50:00.588106 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:50:17.188191 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:50:17.188150 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:50:25.590534 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:50:25.590445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:50:42.177689 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:50:42.177654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:50:50.991167 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:50:50.991129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:51:22.978889 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:51:22.978849 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:51:31.484281 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:51:31.484238 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:51:39.985382 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:51:39.985340 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:51:48.084703 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:51:48.084664 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:51:56.485172 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:51:56.485086 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:52:14.590008 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:52:14.589967 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:52:26.185352 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:52:26.185311 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:16.085354 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:16.085309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:23.490877 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:23.490825 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:29.281324 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:29.281228 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:38.090490 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:38.090447 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:46.985981 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:46.985937 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:53:55.480254 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:53:55.480216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:04.776454 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:04.776414 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:13.587310 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:13.587265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:22.393950 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:22.393915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:29.780282 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:29.780244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:40.091514 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:40.091468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:42.250322 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:42.250276 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:54:42.253544 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:42.253517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:54:42.257830 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:42.257808 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:54:42.260542 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:42.260524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:54:46.788483 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:46.788448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:54:57.882187 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:54:57.882096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:04.387402 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:04.387365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:15.280347 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:15.280303 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:21.886935 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:21.886893 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:34.181559 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:34.181525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:40.586615 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:40.586578 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:47.581909 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:47.581867 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:55:55.584251 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:55:55.584214 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:56:30.834762 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:30.834672 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:56:30.835328 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:30.834946 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" podUID="48bff7fd-1b59-400a-9c8c-06068be2be6d" containerName="manager" containerID="cri-o://3e9030921d209a9dba2110afd772261965988848e78b4b745e8d0b3cf70eaff4" gracePeriod=10 Jun 03 19:56:31.543399 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.543367 2578 generic.go:356] "Generic (PLEG): container finished" podID="48bff7fd-1b59-400a-9c8c-06068be2be6d" containerID="3e9030921d209a9dba2110afd772261965988848e78b4b745e8d0b3cf70eaff4" exitCode=0 Jun 03 19:56:31.543551 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.543434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" event={"ID":"48bff7fd-1b59-400a-9c8c-06068be2be6d","Type":"ContainerDied","Data":"3e9030921d209a9dba2110afd772261965988848e78b4b745e8d0b3cf70eaff4"} Jun 03 19:56:31.599420 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.599390 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:56:31.696167 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.696127 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume\") pod \"48bff7fd-1b59-400a-9c8c-06068be2be6d\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " Jun 03 19:56:31.696342 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.696183 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4qbp\" (UniqueName: \"kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp\") pod \"48bff7fd-1b59-400a-9c8c-06068be2be6d\" (UID: \"48bff7fd-1b59-400a-9c8c-06068be2be6d\") " Jun 03 19:56:31.696485 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.696460 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48bff7fd-1b59-400a-9c8c-06068be2be6d" (UID: "48bff7fd-1b59-400a-9c8c-06068be2be6d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 19:56:31.698220 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.698172 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp" (OuterVolumeSpecName: "kube-api-access-b4qbp") pod "48bff7fd-1b59-400a-9c8c-06068be2be6d" (UID: "48bff7fd-1b59-400a-9c8c-06068be2be6d"). InnerVolumeSpecName "kube-api-access-b4qbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:56:31.797295 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.797255 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4qbp\" (UniqueName: \"kubernetes.io/projected/48bff7fd-1b59-400a-9c8c-06068be2be6d-kube-api-access-b4qbp\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:56:31.797295 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:31.797287 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bff7fd-1b59-400a-9c8c-06068be2be6d-extensions-socket-volume\") on node \"ip-10-0-140-28.ec2.internal\" DevicePath \"\"" Jun 03 19:56:32.549938 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:32.549856 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" Jun 03 19:56:32.549938 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:32.549858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f" event={"ID":"48bff7fd-1b59-400a-9c8c-06068be2be6d","Type":"ContainerDied","Data":"31e84cb0d96926eee09001c971960d1fb07d876353491cda07bceb2fdf82e642"} Jun 03 19:56:32.549938 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:32.549923 2578 scope.go:117] "RemoveContainer" containerID="3e9030921d209a9dba2110afd772261965988848e78b4b745e8d0b3cf70eaff4" Jun 03 19:56:32.569155 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:32.569127 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:56:32.572796 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:32.572767 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpx2f"] Jun 03 19:56:34.156105 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:56:34.156067 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48bff7fd-1b59-400a-9c8c-06068be2be6d" path="/var/lib/kubelet/pods/48bff7fd-1b59-400a-9c8c-06068be2be6d/volumes" Jun 03 19:57:36.958905 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.958855 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6"] Jun 03 19:57:36.959421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.959219 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48bff7fd-1b59-400a-9c8c-06068be2be6d" containerName="manager" Jun 03 19:57:36.959421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.959230 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="48bff7fd-1b59-400a-9c8c-06068be2be6d" containerName="manager" Jun 03 19:57:36.959421 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.959281 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="48bff7fd-1b59-400a-9c8c-06068be2be6d" containerName="manager" Jun 03 19:57:36.962022 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.962004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:36.967330 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.967307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ngf6h\"" Jun 03 19:57:36.976921 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:36.976889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6"] Jun 03 19:57:37.061257 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.061213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.061431 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.061318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5twd\" (UniqueName: \"kubernetes.io/projected/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-kube-api-access-p5twd\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.162503 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.162469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5twd\" (UniqueName: \"kubernetes.io/projected/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-kube-api-access-p5twd\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.162682 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.162530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.162894 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.162878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.171669 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.171630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5twd\" (UniqueName: \"kubernetes.io/projected/aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6-kube-api-access-p5twd\") pod \"kuadrant-operator-controller-manager-86878c769f-4m4z6\" (UID: \"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.272519 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.272426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.423753 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.423726 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6"] Jun 03 19:57:37.426447 ip-10-0-140-28 kubenswrapper[2578]: W0603 19:57:37.426419 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3d6c16_84bb_4fae_8d27_1b6bf48dfcc6.slice/crio-2fffd1e1762f39dda5e65b160d024068481e3b7ee9124f57e08d7297dc3223e4 WatchSource:0}: Error finding container 2fffd1e1762f39dda5e65b160d024068481e3b7ee9124f57e08d7297dc3223e4: Status 404 returned error can't find the container with id 2fffd1e1762f39dda5e65b160d024068481e3b7ee9124f57e08d7297dc3223e4 Jun 03 19:57:37.885996 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.885962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" event={"ID":"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6","Type":"ContainerStarted","Data":"a57ffae18ecb9ff34328fff943555112d6580e77591dcc13cb8c6e6bddd5cb99"} Jun 03 19:57:37.886193 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.886014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" event={"ID":"aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6","Type":"ContainerStarted","Data":"2fffd1e1762f39dda5e65b160d024068481e3b7ee9124f57e08d7297dc3223e4"} Jun 03 19:57:37.886193 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.886106 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:37.909835 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:37.909777 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" podStartSLOduration=1.909761315 podStartE2EDuration="1.909761315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:57:37.907423216 +0000 UTC m=+1676.281540253" watchObservedRunningTime="2026-06-03 19:57:37.909761315 +0000 UTC m=+1676.283878351" Jun 03 19:57:48.894033 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:48.893995 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4m4z6" Jun 03 19:57:58.377527 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:57:58.377434 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:58:05.186081 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:58:05.186041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:58:30.183085 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:58:30.183047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:58:36.379210 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:58:36.379169 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:58:46.487344 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:58:46.487308 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:58:57.086414 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:58:57.086373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:06.281656 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:06.281617 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:16.978637 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:16.978597 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:26.279676 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:26.279585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:35.381339 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:35.381299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:42.283999 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:42.283971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:59:42.289933 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:42.289904 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 19:59:42.291888 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:42.291869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:59:42.296784 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:42.296767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 19:59:44.082301 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:44.082264 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 19:59:55.182082 ip-10-0-140-28 kubenswrapper[2578]: I0603 19:59:55.182043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:00:04.080092 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:00:04.080042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:00:39.581533 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:00:39.581486 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:01:22.979748 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:01:22.979708 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:01:29.576452 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:01:29.576410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:01:40.473048 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:01:40.473004 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:01:47.187790 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:01:47.187751 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:01:55.779960 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:01:55.779910 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:09.079151 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:09.079111 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:19.781258 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:19.781216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:30.781739 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:30.781640 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:39.584716 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:39.584675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:48.782924 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:48.782880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:02:55.175861 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:02:55.175803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:03:05.577172 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:03:05.577125 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:03:22.880209 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:03:22.880166 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:03:32.886981 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:03:32.886943 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:03:41.887154 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:03:41.887116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:03:48.682492 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:03:48.682445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:05.679493 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:05.679448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:15.182195 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:15.182155 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:23.886653 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:23.886608 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:32.985685 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:32.985644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:40.687655 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:40.687610 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:42.319015 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:42.318986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 20:04:42.326513 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:42.326486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 20:04:42.327334 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:42.327303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 20:04:42.333549 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:42.333526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-prsnq_400593bd-b9ff-480b-97a7-7df42e3ed59e/ovn-acl-logging/0.log" Jun 03 20:04:49.685355 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:49.685314 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:04:59.381998 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:04:59.381963 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:05:12.381568 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:05:12.381531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:05:21.381422 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:05:21.381383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:05:34.688200 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:05:34.688105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:05:43.891646 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:05:43.891608 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:05:52.178539 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:05:52.178501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:03.182158 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:03.182120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:11.282698 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:11.282657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:29.776273 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:29.776231 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:36.482793 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:36.482748 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:46.680993 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:46.680953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:06:57.775944 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:06:57.775825 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:07:19.387613 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:19.387571 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:07:31.975653 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:31.975607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vksb7"] Jun 03 20:07:42.622121 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:42.622051 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f58cfb955-dlwjr_d07e5796-a19f-43f4-94b5-92d345511848/nginx/0.log" Jun 03 20:07:43.789094 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:43.789062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-ckjvn_dd4c24fb-8ac7-4492-aab0-d8b057ed59d6/copy-manifests/0.log" Jun 03 20:07:43.796614 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:43.796575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-ckjvn_dd4c24fb-8ac7-4492-aab0-d8b057ed59d6/manager/0.log" Jun 03 20:07:44.919226 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:44.919194 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/util/0.log" Jun 03 20:07:44.926373 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:44.926341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/pull/0.log" Jun 03 20:07:44.934863 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:44.934819 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/extract/0.log" Jun 03 20:07:45.064128 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.064100 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/util/0.log" Jun 03 20:07:45.080935 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.080897 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/pull/0.log" Jun 03 20:07:45.096436 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.096409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/extract/0.log" Jun 03 20:07:45.208145 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.208061 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/util/0.log" Jun 03 20:07:45.215524 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.215497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/pull/0.log" Jun 03 20:07:45.222186 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.222162 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/extract/0.log" Jun 03 20:07:45.336079 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.336047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/util/0.log" Jun 03 20:07:45.345284 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.345261 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/pull/0.log" Jun 03 20:07:45.352058 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.352038 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/extract/0.log" Jun 03 20:07:45.590738 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.590708 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zkffc_eaeb6ea0-70d7-4929-b714-7aaf1ae17971/manager/0.log" Jun 03 20:07:45.810236 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.810209 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ghg24_94ea6280-871c-4b9d-b88e-fe68cb2b5638/kuadrant-console-plugin/0.log" Jun 03 20:07:45.930203 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:45.930113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w9l9f_4fee6f5f-8602-409e-b1b2-9880758c334b/registry-server/0.log" Jun 03 20:07:46.051503 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:46.051476 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4m4z6_aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6/manager/0.log" Jun 03 20:07:46.175826 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:46.175799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vksb7_77590d4a-38ed-4b17-a77f-2cd5306eaf6e/limitador/0.log" Jun 03 20:07:46.646800 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:46.646761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtgfk_df27b98d-d034-4ec2-b3f7-112a29098eaf/istio-proxy/0.log" Jun 03 20:07:48.308530 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:48.308499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-27tjd_db4c4f74-5479-4ef6-a19e-3aed0e378199/storage-initializer/0.log" Jun 03 20:07:48.315990 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:48.315969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-27tjd_db4c4f74-5479-4ef6-a19e-3aed0e378199/main/0.log" Jun 03 20:07:56.111402 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:56.111371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xt6ns_10966712-2deb-4b32-90d8-926d107c2de2/global-pull-secret-syncer/0.log" Jun 03 20:07:56.271454 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:56.271418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxjtv_64dd5f83-bbf6-4991-b673-67d124f7483a/konnectivity-agent/0.log" Jun 03 20:07:56.333243 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:07:56.333203 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-28.ec2.internal_40079a1e2def053464b6f43b377957c7/haproxy/0.log" Jun 03 20:08:00.785011 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.784979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/extract/0.log" Jun 03 20:08:00.808492 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.808464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/util/0.log" Jun 03 20:08:00.838941 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.838910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926mz6_845a5d57-31fd-4602-9fb6-98e09384b6dd/pull/0.log" Jun 03 20:08:00.868745 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.868717 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/extract/0.log" Jun 03 20:08:00.891631 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.891605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/util/0.log" Jun 03 20:08:00.916534 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.916509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mpkf5_86127117-ff35-4afb-92e5-a5b3b4b78080/pull/0.log" Jun 03 20:08:00.945523 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.945489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/extract/0.log" Jun 03 20:08:00.971196 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.971167 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/util/0.log" Jun 03 20:08:00.994675 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:00.994647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738lssl_2b0dbd68-4253-4f5a-81a6-e96d6d728638/pull/0.log" Jun 03 20:08:01.023394 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.023366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/extract/0.log" Jun 03 20:08:01.052011 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.051918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/util/0.log" Jun 03 20:08:01.074125 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.074100 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xf85j_5fad048a-3362-401b-a698-38d8bbbe9e0a/pull/0.log" Jun 03 20:08:01.455058 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.455024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zkffc_eaeb6ea0-70d7-4929-b714-7aaf1ae17971/manager/0.log" Jun 03 20:08:01.528098 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.528064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ghg24_94ea6280-871c-4b9d-b88e-fe68cb2b5638/kuadrant-console-plugin/0.log" Jun 03 20:08:01.567095 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.567060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w9l9f_4fee6f5f-8602-409e-b1b2-9880758c334b/registry-server/0.log" Jun 03 20:08:01.629539 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.629507 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4m4z6_aa3d6c16-84bb-4fae-8d27-1b6bf48dfcc6/manager/0.log" Jun 03 20:08:01.655592 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:01.655561 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vksb7_77590d4a-38ed-4b17-a77f-2cd5306eaf6e/limitador/0.log" Jun 03 20:08:03.645221 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:03.645188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-g8s96_eb4e6c95-1710-488e-999e-fe30271a0004/cluster-monitoring-operator/0.log" Jun 03 20:08:03.954960 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:03.954869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms48c_e68b5669-cd1b-44e3-8be9-a9c8bd1ade27/node-exporter/0.log" Jun 03 20:08:03.976462 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:03.976433 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms48c_e68b5669-cd1b-44e3-8be9-a9c8bd1ade27/kube-rbac-proxy/0.log" Jun 03 20:08:03.998923 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:03.998893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms48c_e68b5669-cd1b-44e3-8be9-a9c8bd1ade27/init-textfile/0.log" Jun 03 20:08:05.941228 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:05.941195 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-c9w8j_812d9d85-dade-470f-b988-3f6c142b9cda/networking-console-plugin/0.log" Jun 03 20:08:06.567563 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:06.567530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/1.log" Jun 03 20:08:06.571457 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:06.571432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-b9qcb_b86dd834-3c3c-48be-98b6-326c0fff3e38/console-operator/2.log" Jun 03 20:08:07.165413 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:07.165383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7764b6df-6rr79_1ac86d31-e5d0-47d1-b2d3-580f3fe35909/console/0.log" Jun 03 20:08:07.236626 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:07.236592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-qd6fh_d4603db2-ed97-4049-a58e-12bafd485921/download-server/0.log" Jun 03 20:08:07.950994 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:07.950964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-dsqt7_234e08b5-b60c-4cf9-a97e-ee15d8786895/volume-data-source-validator/0.log" Jun 03 20:08:08.063510 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.063470 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt"] Jun 03 20:08:08.067733 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.067713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.070492 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.070465 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2jt7\"/\"openshift-service-ca.crt\"" Jun 03 20:08:08.070646 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.070624 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2jt7\"/\"kube-root-ca.crt\"" Jun 03 20:08:08.070718 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.070666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2jt7\"/\"default-dockercfg-r6dvp\"" Jun 03 20:08:08.078132 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.078104 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt"] Jun 03 20:08:08.227564 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.227467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-podres\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.227977 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.227619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-sys\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.227977 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.227924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-proc\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.228114 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.228017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-lib-modules\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.228179 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.228130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wws9q\" (UniqueName: \"kubernetes.io/projected/ca589e17-0bce-4727-98e2-b898a0f142cb-kube-api-access-wws9q\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329451 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-proc\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329643 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-lib-modules\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329643 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-proc\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329643 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wws9q\" (UniqueName: \"kubernetes.io/projected/ca589e17-0bce-4727-98e2-b898a0f142cb-kube-api-access-wws9q\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329643 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-lib-modules\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329818 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-podres\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329818 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329704 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-podres\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329818 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-sys\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.329818 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.329744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca589e17-0bce-4727-98e2-b898a0f142cb-sys\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.338627 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.338603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wws9q\" (UniqueName: \"kubernetes.io/projected/ca589e17-0bce-4727-98e2-b898a0f142cb-kube-api-access-wws9q\") pod \"perf-node-gather-daemonset-tqntt\" (UID: \"ca589e17-0bce-4727-98e2-b898a0f142cb\") " pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.379120 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.379081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:08.524360 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:08.524328 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt"] Jun 03 20:08:08.526148 ip-10-0-140-28 kubenswrapper[2578]: W0603 20:08:08.526115 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca589e17_0bce_4727_98e2_b898a0f142cb.slice/crio-0f2608c7f9f36b8ba66e96d8d3ed2709f46f4769a1b7e52e2c6f9729b283f3f2 WatchSource:0}: Error finding container 0f2608c7f9f36b8ba66e96d8d3ed2709f46f4769a1b7e52e2c6f9729b283f3f2: Status 404 returned error can't find the container with id 0f2608c7f9f36b8ba66e96d8d3ed2709f46f4769a1b7e52e2c6f9729b283f3f2 Jun 03 20:08:09.198491 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.198442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" event={"ID":"ca589e17-0bce-4727-98e2-b898a0f142cb","Type":"ContainerStarted","Data":"dba5a3260a0a4bc48150a49ce7e6fab0bc0ff5b71c8b7bf290360cee9ca9ec25"} Jun 03 20:08:09.198683 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.198609 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:09.198683 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.198641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" event={"ID":"ca589e17-0bce-4727-98e2-b898a0f142cb","Type":"ContainerStarted","Data":"0f2608c7f9f36b8ba66e96d8d3ed2709f46f4769a1b7e52e2c6f9729b283f3f2"} Jun 03 20:08:09.219412 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.219358 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" podStartSLOduration=1.219342905 podStartE2EDuration="1.219342905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:08:09.21830314 +0000 UTC m=+2307.592420171" watchObservedRunningTime="2026-06-03 20:08:09.219342905 +0000 UTC m=+2307.593459941" Jun 03 20:08:09.333540 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.333513 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vkvq7_7c8ebfc9-7904-4fc5-86e1-001a88ab55aa/dns/0.log" Jun 03 20:08:09.358637 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.358611 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vkvq7_7c8ebfc9-7904-4fc5-86e1-001a88ab55aa/kube-rbac-proxy/0.log" Jun 03 20:08:09.411557 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.411523 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bzfs_d2ec455d-8439-467f-aa9a-8e69d52a0d72/dns-node-resolver/0.log" Jun 03 20:08:09.975904 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:09.975867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-868f87d7c6-hnltl_1f425815-bf63-410a-8f57-1c62c3f6710c/registry/0.log" Jun 03 20:08:10.026691 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:10.026659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvhqt_5633f6c7-559e-4400-b6c5-feb3bb2c9ee0/node-ca/0.log" Jun 03 20:08:11.051150 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:11.051121 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtgfk_df27b98d-d034-4ec2-b3f7-112a29098eaf/istio-proxy/0.log" Jun 03 20:08:12.092039 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.092007 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fq27d_3960550a-6bfd-46ea-87e9-716901f7eaf0/serve-healthcheck-canary/0.log" Jun 03 20:08:12.683337 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.683291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-ll9k2_b8542a33-b550-4d3f-955d-076aae969be6/insights-operator/0.log" Jun 03 20:08:12.683735 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.683715 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-ll9k2_b8542a33-b550-4d3f-955d-076aae969be6/insights-operator/1.log" Jun 03 20:08:12.858227 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.858194 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zlf7z_9bfa484c-07fb-4f31-a225-0784672e8b0a/kube-rbac-proxy/0.log" Jun 03 20:08:12.882284 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.882253 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zlf7z_9bfa484c-07fb-4f31-a225-0784672e8b0a/exporter/0.log" Jun 03 20:08:12.907029 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:12.906999 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zlf7z_9bfa484c-07fb-4f31-a225-0784672e8b0a/extractor/0.log" Jun 03 20:08:15.014999 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:15.014966 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f58cfb955-dlwjr_d07e5796-a19f-43f4-94b5-92d345511848/nginx/0.log" Jun 03 20:08:15.214277 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:15.214249 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2jt7/perf-node-gather-daemonset-tqntt" Jun 03 20:08:15.531569 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:15.531541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-ckjvn_dd4c24fb-8ac7-4492-aab0-d8b057ed59d6/manager/0.log" Jun 03 20:08:15.561972 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:15.561943 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84dd8f948c-ckjvn_dd4c24fb-8ac7-4492-aab0-d8b057ed59d6/copy-manifests/0.log" Jun 03 20:08:17.660516 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:17.660487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7db96c8d84-mxzf4_544bdc2a-528b-48b7-b506-9522e535296c/manager/0.log" Jun 03 20:08:20.229058 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:20.229026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtgfk_df27b98d-d034-4ec2-b3f7-112a29098eaf/istio-proxy/0.log" Jun 03 20:08:21.736214 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:21.736172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtgfk_df27b98d-d034-4ec2-b3f7-112a29098eaf/istio-proxy/0.log" Jun 03 20:08:23.959104 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:23.959070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mtgfk_df27b98d-d034-4ec2-b3f7-112a29098eaf/istio-proxy/0.log" Jun 03 20:08:24.600803 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.600774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/kube-multus-additional-cni-plugins/0.log" Jun 03 20:08:24.625154 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.625128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/egress-router-binary-copy/0.log" Jun 03 20:08:24.649052 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.649024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/cni-plugins/0.log" Jun 03 20:08:24.671465 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.671437 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/bond-cni-plugin/0.log" Jun 03 20:08:24.695594 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.695568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/routeoverride-cni/0.log" Jun 03 20:08:24.720889 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.720834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/whereabouts-cni-bincopy/0.log" Jun 03 20:08:24.743324 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:24.743297 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ftml_d2441219-876b-48a7-9656-6bbe829b05a0/whereabouts-cni/0.log" Jun 03 20:08:25.116417 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:25.116381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fkgm7_e8d9b817-dd2d-451d-9408-62cb6191b2cf/kube-multus/0.log" Jun 03 20:08:25.256184 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:25.256143 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sksjb_f194ab89-508e-4ddb-af2c-d83eaa470455/network-metrics-daemon/0.log" Jun 03 20:08:25.276290 ip-10-0-140-28 kubenswrapper[2578]: I0603 20:08:25.276265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sksjb_f194ab89-508e-4ddb-af2c-d83eaa470455/kube-rbac-proxy/0.log"