Jun 09 14:34:05.557791 ip-10-0-143-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 14:34:05.557802 ip-10-0-143-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 14:34:05.557810 ip-10-0-143-134 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 14:34:05.558124 ip-10-0-143-134 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 14:34:15.559103 ip-10-0-143-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 14:34:15.559124 ip-10-0-143-134 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot afff827f7931490eb68cacd26d10e270 -- Jun 09 14:36:58.375494 ip-10-0-143-134 systemd[1]: Starting Kubernetes Kubelet... Jun 09 14:36:58.848250 ip-10-0-143-134 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:36:58.848250 ip-10-0-143-134 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 14:36:58.848250 ip-10-0-143-134 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:36:58.848250 ip-10-0-143-134 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 14:36:58.848250 ip-10-0-143-134 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:36:58.851223 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.851132 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860898 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860917 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860921 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860924 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860928 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860931 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.860925 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860934 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860937 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860940 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860944 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860950 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860953 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860956 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860959 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860962 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860965 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860967 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860970 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860973 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860975 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860978 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860980 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860983 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860985 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860988 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860990 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.861194 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860993 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860996 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.860998 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861001 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861004 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861006 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861009 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861012 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861016 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861019 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861022 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861025 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861028 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861031 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861034 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861037 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861040 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861042 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861045 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.861673 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861048 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861051 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861053 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861056 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861058 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861061 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861064 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861067 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861070 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861073 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861075 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861078 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861080 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861098 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861102 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861106 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861110 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861114 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861120 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861124 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.862203 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861127 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861130 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861133 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861136 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861139 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861142 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861145 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861148 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861150 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861153 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861155 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861159 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861162 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861164 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861167 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861170 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861172 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861175 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861178 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861181 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.862686 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861184 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861186 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861189 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861191 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861194 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861197 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861199 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861202 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861205 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861208 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861211 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861213 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861216 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861220 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861962 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861968 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861972 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861975 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861977 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861981 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.863178 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861984 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861987 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861989 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861992 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861995 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.861997 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862000 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862002 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862005 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862007 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862010 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862014 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862016 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862018 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862021 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862023 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862026 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862028 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862031 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862033 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.863662 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862035 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862039 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862041 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862043 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862046 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862059 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862062 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862064 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862067 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862070 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862072 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862075 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862078 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862080 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862097 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862101 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862103 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862106 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862108 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.864172 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862111 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862114 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862116 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862119 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862121 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862124 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862127 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862130 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862132 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862135 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862137 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862139 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862142 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862144 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862147 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862151 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862155 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862158 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862161 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862164 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.864638 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862167 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862169 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862172 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862175 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862179 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862182 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862185 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862189 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862192 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862195 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862197 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862200 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862202 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862205 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862207 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862210 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862213 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862217 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862221 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.865149 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862225 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862228 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862231 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862234 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862236 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862239 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862242 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862245 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862247 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862250 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862252 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862255 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862257 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862259 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862262 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862652 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862657 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862661 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862663 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862666 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.865612 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862669 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862671 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862674 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862676 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862679 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862681 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862686 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862689 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862693 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862696 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862698 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862702 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862705 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862708 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862710 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862713 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862715 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862718 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862720 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.866142 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862723 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862726 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862728 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862731 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862733 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862736 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862738 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862741 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862743 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862746 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862749 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862751 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862754 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862756 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862759 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862761 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862764 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862767 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862769 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862772 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.866607 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862774 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862776 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862779 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862781 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862784 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862791 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862794 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862797 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862799 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862802 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862804 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862807 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862809 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862811 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862814 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862816 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862819 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862821 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862824 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862826 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.867111 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862829 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862833 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862836 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862838 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862841 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862843 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862846 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862848 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862850 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862853 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862855 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862859 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862862 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862866 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862869 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862873 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862875 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862879 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862882 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.867613 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862885 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862887 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862890 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862892 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862895 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862898 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862901 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862903 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862906 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862908 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862912 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862914 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862916 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862919 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862921 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.862924 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863001 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863008 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863014 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863019 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863023 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 14:36:58.868170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863026 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863030 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863034 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863037 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863040 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863044 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863047 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863050 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863053 2564 flags.go:64] FLAG: --cgroup-root="" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863057 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863060 2564 flags.go:64] FLAG: --client-ca-file="" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863063 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863066 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863071 2564 flags.go:64] FLAG: --cluster-domain="" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863073 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863077 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863080 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863098 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863102 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863105 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863108 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863111 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863114 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863117 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 14:36:58.868677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863120 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863123 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863127 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863131 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863134 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863137 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863140 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863143 2564 flags.go:64] FLAG: --enable-server="true" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863146 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863151 2564 flags.go:64] FLAG: --event-burst="100" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863154 2564 flags.go:64] FLAG: --event-qps="50" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863157 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863159 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863162 2564 flags.go:64] FLAG: --eviction-hard="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863166 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863169 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863172 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863176 2564 flags.go:64] FLAG: --eviction-soft="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863179 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863182 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863185 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863188 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863191 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863194 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863197 2564 flags.go:64] FLAG: --feature-gates="" Jun 09 14:36:58.869272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863200 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863203 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863206 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863209 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863212 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863215 2564 flags.go:64] FLAG: --help="false" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863218 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-134.ec2.internal" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863221 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863224 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863228 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863231 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863234 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863237 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863240 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863242 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863245 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863248 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863250 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863253 2564 flags.go:64] FLAG: --kube-reserved="" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863256 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863258 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863261 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863264 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863266 2564 flags.go:64] FLAG: --lock-file="" Jun 09 14:36:58.869937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863270 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863273 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863276 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863281 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863284 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863287 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863290 2564 flags.go:64] FLAG: --logging-format="text" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863292 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863295 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863298 2564 flags.go:64] FLAG: --manifest-url="" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863301 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863305 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863308 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863312 2564 flags.go:64] FLAG: --max-pods="110" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863315 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863318 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863320 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863324 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863327 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863330 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863333 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863341 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863344 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863347 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 14:36:58.870591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863350 2564 flags.go:64] FLAG: --pod-cidr="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863352 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863358 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863361 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863364 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863367 2564 flags.go:64] FLAG: --port="10250" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863370 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863373 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d25576c0a939a81" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863376 2564 flags.go:64] FLAG: --qos-reserved="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863379 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863382 2564 flags.go:64] FLAG: --register-node="true" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863385 2564 flags.go:64] FLAG: --register-with-taints="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863389 2564 flags.go:64] FLAG: --registry-burst="10" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863392 2564 flags.go:64] FLAG: --registry-qps="5" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863395 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863398 2564 flags.go:64] FLAG: --reserved-memory="" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863401 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863405 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863407 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863410 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863413 2564 flags.go:64] FLAG: --runonce="false" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863415 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863418 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863421 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863424 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 14:36:58.871181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863428 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863431 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863434 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863437 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863440 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863443 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863445 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863448 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863451 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863454 2564 flags.go:64] FLAG: --system-cgroups="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863456 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863461 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863464 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863467 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863471 2564 flags.go:64] FLAG: --tls-min-version="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863474 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863477 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863479 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863482 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863485 2564 flags.go:64] FLAG: --v="2" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863489 2564 flags.go:64] FLAG: --version="false" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863493 2564 flags.go:64] FLAG: --vmodule="" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863497 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.863500 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863616 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.871821 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863619 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863622 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863625 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863627 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863630 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863633 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863635 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863639 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863641 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863644 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863647 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863649 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863652 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863654 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863657 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863659 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863662 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863665 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863667 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863670 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.872450 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863672 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863675 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863678 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863681 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863683 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863686 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863688 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863691 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863694 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863703 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863706 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863709 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863712 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863714 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863717 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863720 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863722 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863725 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863728 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863732 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.872930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863735 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863737 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863740 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863743 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863745 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863748 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863750 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863753 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863755 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863759 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863761 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863764 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863766 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863770 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863773 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863776 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863779 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863783 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863786 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.873438 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863789 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863792 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863795 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863798 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863800 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863802 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863805 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863808 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863810 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863813 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863815 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863818 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863822 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863825 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863828 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863830 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863832 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863835 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863837 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863840 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.873907 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863842 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863845 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863850 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863852 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863855 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863857 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863860 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863862 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863865 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863868 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863870 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863873 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863875 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863877 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863880 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863882 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863885 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863888 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.874490 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.863890 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.864555 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.871887 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.871906 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.871926 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.871932 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.871988 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.871994 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.871998 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872002 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872005 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872009 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872012 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872015 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.874918 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872018 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872021 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872023 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872026 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872029 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872032 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872034 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872037 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872040 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872042 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872045 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872049 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872052 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872055 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872058 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872060 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872063 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872065 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872068 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.875278 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872070 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872072 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872077 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872079 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872099 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872103 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872107 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872110 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872113 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872115 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872118 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872120 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872123 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872126 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872128 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872131 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872133 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872136 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872138 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872141 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.875728 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872143 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872146 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872148 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872150 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872153 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872155 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872157 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872160 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872162 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872165 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872167 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872170 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872172 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872174 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872178 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872181 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872184 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872187 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872189 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872192 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.876230 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872194 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872197 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872200 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872202 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872204 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872207 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872210 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872212 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872214 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872217 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872220 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872223 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872225 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872228 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872231 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872233 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872237 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872240 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872242 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872245 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.876787 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872247 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872250 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872252 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872255 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872257 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872260 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872262 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872265 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872268 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872271 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872274 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872276 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.872281 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872420 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872425 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:36:58.877316 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872429 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872432 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872435 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872438 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872440 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872443 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872446 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872449 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872452 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872455 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872458 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872461 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872463 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872466 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872469 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872471 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872473 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872476 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872478 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:36:58.877691 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872481 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872483 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872486 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872488 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872491 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872493 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872496 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872499 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872502 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872504 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872507 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872509 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872512 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872514 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872516 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872519 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872522 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872524 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872527 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872529 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:36:58.878204 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872532 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872534 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872537 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872539 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872542 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872544 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872547 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872550 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872552 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872555 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872557 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872560 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872563 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872565 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872567 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872570 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872573 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872575 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872578 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872581 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:36:58.878683 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872584 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872586 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872589 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872591 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872594 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872596 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872599 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872601 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872603 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872606 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872610 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872613 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872616 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872619 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872621 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872624 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872627 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872629 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872634 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:36:58.879169 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872638 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872642 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872645 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872647 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872650 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872652 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872655 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872658 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872660 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872663 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872665 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872668 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872670 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872672 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872675 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872678 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872680 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872683 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:36:58.879630 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:36:58.872685 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.872689 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.872805 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.876155 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.877875 2564 server.go:1019] "Starting client certificate rotation" Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.877973 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:36:58.880064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.878003 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:36:58.881151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.881137 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:36:58.889290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.889269 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:36:58.903764 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.903741 2564 log.go:25] "Validated CRI v1 runtime API" Jun 09 14:36:58.906768 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.906751 2564 log.go:25] "Validated CRI v1 image API" Jun 09 14:36:58.907549 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.907533 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 14:36:58.910948 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.910927 2564 fs.go:135] Filesystem UUIDs: map[21e21e10-5374-4dd8-b4f3-fbbcd42eb144:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9c7c4e50-c853-457e-9cff-a462398c7292:/dev/nvme0n1p3] Jun 09 14:36:58.911014 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.910947 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 14:36:58.916924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.916804 2564 manager.go:216] Machine: {Timestamp:2026-06-09 14:36:58.915434002 +0000 UTC m=+0.398708742 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102207 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dfca03828c51748f16c53194bbaf1 SystemUUID:ec2dfca0-3828-c517-48f1-6c53194bbaf1 BootID:afff827f-7931-490e-b68c-acd26d10e270 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:3b:98:40:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:3b:98:40:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:b4:38:a5:ab:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 14:36:58.916924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.916919 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 14:36:58.917072 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.917060 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 14:36:58.918966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.918948 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:36:58.919992 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.919963 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 14:36:58.920145 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.919996 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 14:36:58.921695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.921644 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 14:36:58.921695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.921663 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 14:36:58.921695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.921672 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:36:58.922474 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.922463 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:36:58.923641 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.923631 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 14:36:58.927739 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927727 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:36:58.927854 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927845 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 14:36:58.927897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927873 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 09 14:36:58.927897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927892 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 14:36:58.927967 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927903 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 14:36:58.927967 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927914 2564 kubelet.go:398] "Adding apiserver pod source" Jun 09 14:36:58.927967 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.927923 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 14:36:58.928282 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.928269 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:36:58.928324 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.928296 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:36:58.930762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.930740 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 14:36:58.932878 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.932860 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 14:36:58.932931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.932918 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 14:36:58.933749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933738 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 14:36:58.933783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933755 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 14:36:58.933783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933761 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 14:36:58.933783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933767 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 14:36:58.933783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933775 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 14:36:58.933783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933780 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933846 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933851 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933857 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933863 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933871 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 14:36:58.933934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.933879 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 14:36:58.938405 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.938391 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 14:36:58.938462 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.938409 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 14:36:58.941881 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.941863 2564 server.go:1268] "Started kubelet" Jun 09 14:36:58.942009 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.941949 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 14:36:58.942074 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.942008 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 14:36:58.942074 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.942037 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 14:36:58.942750 ip-10-0-143-134 systemd[1]: Started Kubernetes Kubelet. Jun 09 14:36:58.945488 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.945410 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 14:36:58.946504 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.946483 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 09 14:36:58.947537 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.947515 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 14:36:58.947620 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.947595 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 14:36:58.950263 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.950243 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 14:36:58.952679 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.952659 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 14:36:58.953660 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.952469 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-134.ec2.internal.18b770737b611d4f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-134.ec2.internal,UID:ip-10-0-143-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-134.ec2.internal,},FirstTimestamp:2026-06-09 14:36:58.941832527 +0000 UTC m=+0.425107256,LastTimestamp:2026-06-09 14:36:58.941832527 +0000 UTC m=+0.425107256,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-134.ec2.internal,}" Jun 09 14:36:58.954260 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.954243 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 14:36:58.954425 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.954312 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 14:36:58.954572 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.954545 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:58.955116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955078 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 14:36:58.955202 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955119 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 14:36:58.955252 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955238 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 14:36:58.955299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955258 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 09 14:36:58.955299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955267 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 09 14:36:58.955299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955274 2564 factory.go:55] Registering systemd factory Jun 09 14:36:58.955299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955291 2564 factory.go:223] Registration of the systemd container factory successfully Jun 09 14:36:58.955670 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955651 2564 factory.go:153] Registering CRI-O factory Jun 09 14:36:58.955670 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955671 2564 factory.go:223] Registration of the crio container factory successfully Jun 09 14:36:58.955767 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955734 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 14:36:58.955767 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955758 2564 factory.go:103] Registering Raw factory Jun 09 14:36:58.955834 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.955776 2564 manager.go:1196] Started watching for new ooms in manager Jun 09 14:36:58.956927 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.956902 2564 manager.go:349] Starting recovery of all containers Jun 09 14:36:58.962553 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.962524 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 14:36:58.962639 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.962586 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 14:36:58.970658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.970632 2564 manager.go:354] Recovery completed Jun 09 14:36:58.974474 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.974461 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:58.976933 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.976910 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:58.976982 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.976948 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:58.976982 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.976960 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:58.977527 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.977514 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 14:36:58.977592 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.977528 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 14:36:58.977592 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.977545 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:36:58.977592 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.977519 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:58.978343 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.978328 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:58.978402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.978355 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:58.978402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.978365 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:58.979721 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.979709 2564 policy_none.go:49] "None policy: Start" Jun 09 14:36:58.979762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.979725 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 14:36:58.979762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.979735 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 14:36:58.980250 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.980149 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-134.ec2.internal.18b770737d78b6c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-134.ec2.internal,UID:ip-10-0-143-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-134.ec2.internal,},FirstTimestamp:2026-06-09 14:36:58.976933572 +0000 UTC m=+0.460208303,LastTimestamp:2026-06-09 14:36:58.976933572 +0000 UTC m=+0.460208303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-134.ec2.internal,}" Jun 09 14:36:58.981423 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:58.981410 2564 policy_none.go:47] "Start" Jun 09 14:36:58.993248 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:58.993181 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-134.ec2.internal.18b770737d7905d0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-134.ec2.internal,UID:ip-10-0-143-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-134.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-134.ec2.internal,},FirstTimestamp:2026-06-09 14:36:58.976953808 +0000 UTC m=+0.460228536,LastTimestamp:2026-06-09 14:36:58.976953808 +0000 UTC m=+0.460228536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-134.ec2.internal,}" Jun 09 14:36:59.003686 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.003661 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn9b7" Jun 09 14:36:59.003798 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.003623 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-134.ec2.internal.18b770737d792f15 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-134.ec2.internal,UID:ip-10-0-143-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-134.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-134.ec2.internal,},FirstTimestamp:2026-06-09 14:36:58.976964373 +0000 UTC m=+0.460239105,LastTimestamp:2026-06-09 14:36:58.976964373 +0000 UTC m=+0.460239105,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-134.ec2.internal,}" Jun 09 14:36:59.012509 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.012486 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn9b7" Jun 09 14:36:59.014471 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.014360 2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-134.ec2.internal.18b770737d78b6c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-134.ec2.internal.18b770737d78b6c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-134.ec2.internal,UID:ip-10-0-143-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-134.ec2.internal,},FirstTimestamp:2026-06-09 14:36:58.976933572 +0000 UTC m=+0.460208303,LastTimestamp:2026-06-09 14:36:58.978343227 +0000 UTC m=+0.461617956,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-134.ec2.internal,}" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.030825 2564 manager.go:337] "Starting Device Plugin manager" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.030855 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.030866 2564 server.go:87] "Starting device plugin registration server" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.031134 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.031146 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.031251 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.031334 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.031343 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.031972 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.032013 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.035455 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.036821 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.036851 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.036868 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.036953 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 14:36:59.042852 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.038748 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:36:59.131742 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.131649 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:59.132646 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.132630 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:59.132718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.132665 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:59.132718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.132676 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:59.132718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.132699 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.137148 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.137121 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal"] Jun 09 14:36:59.137207 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.137193 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:59.137983 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.137966 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:59.138037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.137997 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:59.138037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.138011 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:59.140340 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.140326 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:59.140447 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.140433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.140493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.140468 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:59.141067 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141054 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:59.141163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141065 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:59.141163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141080 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:59.141163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141110 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:59.141163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141113 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:59.141163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.141122 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:59.143267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.143249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.143334 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.143285 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:36:59.143891 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.143877 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:36:59.143957 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.143903 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:36:59.143957 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.143913 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:36:59.144142 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.144130 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.144188 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.144149 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-134.ec2.internal\": node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.177894 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.177866 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-134.ec2.internal\" not found" node="ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.182182 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.182164 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-134.ec2.internal\" not found" node="ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.186142 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.186124 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.255930 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.255901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f940acdef2a382196cf29d0889dfafe1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-134.ec2.internal\" (UID: \"f940acdef2a382196cf29d0889dfafe1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.256064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.255948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.256064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.255977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.286306 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.286276 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.356225 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.356299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.356299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f940acdef2a382196cf29d0889dfafe1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-134.ec2.internal\" (UID: \"f940acdef2a382196cf29d0889dfafe1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.356299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.356406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356297 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/423066f5cca00fcfbe9555c22f22915b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal\" (UID: \"423066f5cca00fcfbe9555c22f22915b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.356406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.356340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f940acdef2a382196cf29d0889dfafe1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-134.ec2.internal\" (UID: \"f940acdef2a382196cf29d0889dfafe1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.386540 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.386480 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.484983 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.484951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.487109 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.487076 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.489339 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.489055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:36:59.587746 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.587708 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.688308 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.688220 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.788869 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.788820 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.877399 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.877363 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 14:36:59.877941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:36:59.877520 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 14:36:59.889681 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.889651 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:36:59.990350 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:36:59.990133 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:37:00.016323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.016287 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:31:59 +0000 UTC" deadline="2027-12-05 06:47:21.209861145 +0000 UTC" Jun 09 14:37:00.016323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.016320 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13048h10m21.193544356s" Jun 09 14:37:00.022069 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:00.022033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf940acdef2a382196cf29d0889dfafe1.slice/crio-ed6211294c35a7a1d8fc9832b034e40ab622302616a747e0eaf471d2413ad6f5 WatchSource:0}: Error finding container ed6211294c35a7a1d8fc9832b034e40ab622302616a747e0eaf471d2413ad6f5: Status 404 returned error can't find the container with id ed6211294c35a7a1d8fc9832b034e40ab622302616a747e0eaf471d2413ad6f5 Jun 09 14:37:00.027723 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.027708 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:37:00.040638 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.040584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" event={"ID":"f940acdef2a382196cf29d0889dfafe1","Type":"ContainerStarted","Data":"ed6211294c35a7a1d8fc9832b034e40ab622302616a747e0eaf471d2413ad6f5"} Jun 09 14:37:00.045972 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:00.045952 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423066f5cca00fcfbe9555c22f22915b.slice/crio-8e728729e24a908b8f3a0ea2b3668e9a71fc6477c9ac5d8835fa78d712ed3cc7 WatchSource:0}: Error finding container 8e728729e24a908b8f3a0ea2b3668e9a71fc6477c9ac5d8835fa78d712ed3cc7: Status 404 returned error can't find the container with id 8e728729e24a908b8f3a0ea2b3668e9a71fc6477c9ac5d8835fa78d712ed3cc7 Jun 09 14:37:00.090897 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:00.090856 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:37:00.100039 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.100014 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:00.101049 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.101032 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:00.101150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.101064 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:00.101150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.101078 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:00.191459 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:00.191429 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-134.ec2.internal\" not found" Jun 09 14:37:00.203116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.203079 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:00.255636 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.255530 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" Jun 09 14:37:00.269685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.269660 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:37:00.272142 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.272129 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" Jun 09 14:37:00.281191 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.281174 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:37:00.333566 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.333533 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:00.545473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.545390 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:00.929611 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.929532 2564 apiserver.go:52] "Watching apiserver" Jun 09 14:37:00.937496 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.937471 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 14:37:00.937917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.937888 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-znl82","kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal","openshift-multus/network-metrics-daemon-7swzz","openshift-network-operator/iptables-alerter-t9s9b","openshift-ovn-kubernetes/ovnkube-node-9qssn","kube-system/konnectivity-agent-spdt2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb","openshift-cluster-node-tuning-operator/tuned-v5khd","openshift-dns/node-resolver-nsvdz","openshift-image-registry/node-ca-jv9dk","openshift-multus/multus-55qlb","openshift-multus/multus-additional-cni-plugins-86wdz","openshift-network-diagnostics/network-check-target-98jnq"] Jun 09 14:37:00.940500 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.940466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:00.942558 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.942540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.943229 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.943207 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 14:37:00.943314 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.943240 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 14:37:00.943314 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.943249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m4bkn\"" Jun 09 14:37:00.944618 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:00.944711 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:00.944667 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:00.944792 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944772 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.944957 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 14:37:00.945055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 14:37:00.945055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944982 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 14:37:00.945055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.944941 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5s4b7\"" Jun 09 14:37:00.945579 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.945559 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.946832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.946816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:00.946951 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:00.946901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:00.949019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.948999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:00.951441 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.951424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.951592 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.951568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.951687 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.951647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 14:37:00.951687 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.951570 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.951875 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.951856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nh6xz\"" Jun 09 14:37:00.953680 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.953664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.954298 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.954075 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 14:37:00.954298 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.954131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 14:37:00.955112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955024 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 14:37:00.955112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.955683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955665 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.955931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmxds\"" Jun 09 14:37:00.956076 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:00.956297 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.956143 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 14:37:00.956297 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:00.956171 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:00.956297 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.955988 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 14:37:00.956677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.956655 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9bx96\"" Jun 09 14:37:00.956758 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.956724 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.957192 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.957171 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.958473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.958388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:00.961639 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.961617 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.961782 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.961763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 14:37:00.962125 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.962076 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.962777 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.962734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cngln\"" Jun 09 14:37:00.963469 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.963449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:00.965193 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9lv\" (UniqueName: \"kubernetes.io/projected/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-kube-api-access-bp9lv\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:00.965358 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-kubelet\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965459 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-netd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965459 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-env-overrides\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965459 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovn-node-metrics-cert\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cnibin\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-node-log\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-config\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mvv4\" (UniqueName: \"kubernetes.io/projected/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-kube-api-access-6mvv4\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysconfig\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-systemd\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-ovn\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-bin\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-kubernetes\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-conf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-sys\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-lib-modules\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-iptables-alerter-script\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-netns\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-systemd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-var-lib-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-etc-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-log-socket\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.965977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.965958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-slash\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-script-lib\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xkgzf\"" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-run\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-host\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-tuned\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-kubelet-config\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-host-slash\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-systemd-units\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-modprobe-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6jf\" (UniqueName: \"kubernetes.io/projected/dd3c54ac-bdbd-4525-82a3-da998b922861-kube-api-access-9r6jf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.966572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-system-cni-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-agent-certs\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-binary-copy\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-tuning-conf-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9w4\" (UniqueName: \"kubernetes.io/projected/1ae5f1f5-2dd1-48e0-951d-e2affc416875-kube-api-access-pd9w4\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmc5\" (UniqueName: \"kubernetes.io/projected/1ada3f09-e116-4309-8c2c-5138f9c62af3-kube-api-access-gkmc5\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-var-lib-kubelet\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-tmp\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-konnectivity-ca\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-dbus\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-os-release\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:00.967278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.966853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:00.968683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.968663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55qlb" Jun 09 14:37:00.968903 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.968885 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 14:37:00.969306 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.969287 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 14:37:00.969470 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.969454 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jkmzb\"" Jun 09 14:37:00.970069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.970051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 14:37:00.972305 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.972282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 14:37:00.972500 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.972486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xhcfv\"" Jun 09 14:37:00.974211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:00.974175 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:37:01.042797 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.042767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" event={"ID":"423066f5cca00fcfbe9555c22f22915b","Type":"ContainerStarted","Data":"8e728729e24a908b8f3a0ea2b3668e9a71fc6477c9ac5d8835fa78d712ed3cc7"} Jun 09 14:37:01.055970 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.055944 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 14:37:01.067623 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-binary-copy\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.067769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.067769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-netns\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.067769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-tuning-conf-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.067928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-cnibin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.067928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-etc-kubernetes\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.067928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmmjq\" (UniqueName: \"kubernetes.io/projected/a354512e-ca37-40df-a6ea-33f8b1930c59-kube-api-access-kmmjq\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.067928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.067845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-konnectivity-ca\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:01.068131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-tuning-conf-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.068183 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49567040-a90c-43a8-9cef-44956944a72a-hosts-file\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.068230 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z66js\" (UniqueName: \"kubernetes.io/projected/49567040-a90c-43a8-9cef-44956944a72a-kube-api-access-z66js\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.068230 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cnibin\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.068336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49567040-a90c-43a8-9cef-44956944a72a-tmp-dir\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.068336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068306 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cnibin\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.068336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-binary-copy\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.068478 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-registration-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.068478 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-kubelet\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.068478 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-node-log\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068478 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068444 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-konnectivity-ca\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-node-log\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysconfig\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-sys-fs\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysconfig\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-socket-dir-parent\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-bin\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-conf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-lib-modules\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-host\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.068635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntb8\" (UniqueName: \"kubernetes.io/projected/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-kube-api-access-qntb8\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-bin\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-iptables-alerter-script\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-netns\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-var-lib-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-log-socket\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068752 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-lib-modules\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068789 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068904 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-conf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.068929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-script-lib\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.068980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-slash\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-host\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-kubelet-config\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-system-cni-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-socket-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-host-slash\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6jf\" (UniqueName: \"kubernetes.io/projected/dd3c54ac-bdbd-4525-82a3-da998b922861-kube-api-access-9r6jf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmc5\" (UniqueName: \"kubernetes.io/projected/1ada3f09-e116-4309-8c2c-5138f9c62af3-kube-api-access-gkmc5\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-k8s-cni-cncf-io\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-agent-certs\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069248 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-iptables-alerter-script\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.069264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9w4\" (UniqueName: \"kubernetes.io/projected/1ae5f1f5-2dd1-48e0-951d-e2affc416875-kube-api-access-pd9w4\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-serviceca\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-run-netns\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-multus\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069346 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-var-lib-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-log-socket\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-conf-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-daemon-config\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-var-lib-kubelet\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-tmp\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-dbus\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-os-release\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-device-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9lv\" (UniqueName: \"kubernetes.io/projected/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-kube-api-access-bp9lv\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-kubelet\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-netd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-env-overrides\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.069907 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovn-node-metrics-cert\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-hostroot\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-config\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mvv4\" (UniqueName: \"kubernetes.io/projected/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-kube-api-access-6mvv4\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-systemd\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pg9m\" (UniqueName: \"kubernetes.io/projected/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kube-api-access-8pg9m\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-os-release\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-ovn\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-kubernetes\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-sys\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-script-lib\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-system-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-cni-binary-copy\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-systemd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-slash\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-etc-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.070713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-run\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-host\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.069993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-tuned\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-kubelet-config\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-bin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-multus-certs\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-systemd-units\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-modprobe-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070471 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-var-lib-kubelet\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.070611 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.070665 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:01.570644492 +0000 UTC m=+3.053919208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:01.071407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070712 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070755 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0177362c-e8a9-47c0-a195-4a1b53401fc8-dbus\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-os-release\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.070841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ae5f1f5-2dd1-48e0-951d-e2affc416875-system-cni-dir\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.071061 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-kubelet\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.071135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:01.571119257 +0000 UTC m=+3.054393974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-host-slash\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071294 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ae5f1f5-2dd1-48e0-951d-e2affc416875-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-systemd-units\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovnkube-config\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-host-cni-netd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-systemd\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-modprobe-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-kubernetes\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-ovn\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-run-systemd\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-env-overrides\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.071903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-sys\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.072002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-run\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.072011 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-sysctl-d\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.072988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.072038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-etc-openvswitch\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.074412 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.074394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-tmp\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.074595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.074574 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-ovn-node-metrics-cert\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.074706 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.074684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf5c8ec-8f16-4b80-9012-c2f211db2b98-agent-certs\") pod \"konnectivity-agent-spdt2\" (UID: \"2cf5c8ec-8f16-4b80-9012-c2f211db2b98\") " pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:01.074822 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.074805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd3c54ac-bdbd-4525-82a3-da998b922861-etc-tuned\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.086127 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.085877 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:01.086127 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.085903 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:01.086127 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.085917 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:01.086127 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.085988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:01.5859584 +0000 UTC m=+3.069233135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:01.088702 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.088673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6jf\" (UniqueName: \"kubernetes.io/projected/dd3c54ac-bdbd-4525-82a3-da998b922861-kube-api-access-9r6jf\") pod \"tuned-v5khd\" (UID: \"dd3c54ac-bdbd-4525-82a3-da998b922861\") " pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.088879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.088860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9lv\" (UniqueName: \"kubernetes.io/projected/fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18-kube-api-access-bp9lv\") pod \"iptables-alerter-t9s9b\" (UID: \"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18\") " pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.089037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.089018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmc5\" (UniqueName: \"kubernetes.io/projected/1ada3f09-e116-4309-8c2c-5138f9c62af3-kube-api-access-gkmc5\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:01.089323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.089302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9w4\" (UniqueName: \"kubernetes.io/projected/1ae5f1f5-2dd1-48e0-951d-e2affc416875-kube-api-access-pd9w4\") pod \"multus-additional-cni-plugins-86wdz\" (UID: \"1ae5f1f5-2dd1-48e0-951d-e2affc416875\") " pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.089428 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.089411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mvv4\" (UniqueName: \"kubernetes.io/projected/3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854-kube-api-access-6mvv4\") pod \"ovnkube-node-9qssn\" (UID: \"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.126771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.126737 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-547jg" Jun 09 14:37:01.134097 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.134067 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-547jg" Jun 09 14:37:01.171100 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-netns\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-netns\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-cnibin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-etc-kubernetes\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmjq\" (UniqueName: \"kubernetes.io/projected/a354512e-ca37-40df-a6ea-33f8b1930c59-kube-api-access-kmmjq\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-cnibin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49567040-a90c-43a8-9cef-44956944a72a-hosts-file\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.171386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z66js\" (UniqueName: \"kubernetes.io/projected/49567040-a90c-43a8-9cef-44956944a72a-kube-api-access-z66js\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49567040-a90c-43a8-9cef-44956944a72a-tmp-dir\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171407 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49567040-a90c-43a8-9cef-44956944a72a-hosts-file\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-etc-kubernetes\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-registration-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-registration-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-kubelet\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-sys-fs\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-socket-dir-parent\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-host\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-kubelet\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.171614 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qntb8\" (UniqueName: \"kubernetes.io/projected/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-kube-api-access-qntb8\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-socket-dir-parent\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-socket-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171691 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-sys-fs\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-k8s-cni-cncf-io\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-k8s-cni-cncf-io\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-serviceca\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171737 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49567040-a90c-43a8-9cef-44956944a72a-tmp-dir\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-multus\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-conf-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-host\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-daemon-config\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-multus\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-socket-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-device-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171850 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-conf-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-hostroot\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-hostroot\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-device-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pg9m\" (UniqueName: \"kubernetes.io/projected/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kube-api-access-8pg9m\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-os-release\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-system-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-cni-binary-copy\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-bin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-multus-certs\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-system-cni-dir\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-run-multus-certs\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-os-release\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.171978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-serviceca\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8037324e-1cf3-4be1-a3c9-e1bb842305cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a354512e-ca37-40df-a6ea-33f8b1930c59-host-var-lib-cni-bin\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-multus-daemon-config\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.172845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.172656 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a354512e-ca37-40df-a6ea-33f8b1930c59-cni-binary-copy\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.187707 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.187648 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z66js\" (UniqueName: \"kubernetes.io/projected/49567040-a90c-43a8-9cef-44956944a72a-kube-api-access-z66js\") pod \"node-resolver-nsvdz\" (UID: \"49567040-a90c-43a8-9cef-44956944a72a\") " pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.194046 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.194013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntb8\" (UniqueName: \"kubernetes.io/projected/18a5aaeb-a11e-4c31-882e-fd0fdb42de16-kube-api-access-qntb8\") pod \"node-ca-jv9dk\" (UID: \"18a5aaeb-a11e-4c31-882e-fd0fdb42de16\") " pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.194815 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.194792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pg9m\" (UniqueName: \"kubernetes.io/projected/8037324e-1cf3-4be1-a3c9-e1bb842305cd-kube-api-access-8pg9m\") pod \"aws-ebs-csi-driver-node-cbtlb\" (UID: \"8037324e-1cf3-4be1-a3c9-e1bb842305cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.196333 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.196312 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmmjq\" (UniqueName: \"kubernetes.io/projected/a354512e-ca37-40df-a6ea-33f8b1930c59-kube-api-access-kmmjq\") pod \"multus-55qlb\" (UID: \"a354512e-ca37-40df-a6ea-33f8b1930c59\") " pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.251450 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.251425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:01.259059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.259037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-86wdz" Jun 09 14:37:01.259814 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.259797 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:01.271308 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.271283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9s9b" Jun 09 14:37:01.277712 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.277454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:01.284211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.284194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5khd" Jun 09 14:37:01.291893 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.291870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" Jun 09 14:37:01.297318 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.297300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nsvdz" Jun 09 14:37:01.304061 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.304042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv9dk" Jun 09 14:37:01.309587 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.309563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55qlb" Jun 09 14:37:01.576438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.576364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:01.576438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.576398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:01.576640 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.576501 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:01.576640 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.576522 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:01.576640 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.576562 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:02.576544398 +0000 UTC m=+4.059819116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:01.576640 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.576584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:02.576567686 +0000 UTC m=+4.059842415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:01.677232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:01.677195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:01.677394 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.677372 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:01.677460 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.677400 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:01.677460 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.677410 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:01.677553 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:01.677467 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:02.67744828 +0000 UTC m=+4.160723017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:01.923483 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.923458 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a5aaeb_a11e_4c31_882e_fd0fdb42de16.slice/crio-fbaf8e957e2153a6275fcc7b3e1d2b93a4b9bfc9a67e06c5dc4010632043ab30 WatchSource:0}: Error finding container fbaf8e957e2153a6275fcc7b3e1d2b93a4b9bfc9a67e06c5dc4010632043ab30: Status 404 returned error can't find the container with id fbaf8e957e2153a6275fcc7b3e1d2b93a4b9bfc9a67e06c5dc4010632043ab30 Jun 09 14:37:01.924560 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.924537 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8037324e_1cf3_4be1_a3c9_e1bb842305cd.slice/crio-ecc20b5a30df0c9b58f8bbb0f3397ca6569b7ebb4549fda084933ac9a4ab3cc7 WatchSource:0}: Error finding container ecc20b5a30df0c9b58f8bbb0f3397ca6569b7ebb4549fda084933ac9a4ab3cc7: Status 404 returned error can't find the container with id ecc20b5a30df0c9b58f8bbb0f3397ca6569b7ebb4549fda084933ac9a4ab3cc7 Jun 09 14:37:01.925275 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.925242 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf5c8ec_8f16_4b80_9012_c2f211db2b98.slice/crio-871e6255085cf7010c586c3ad0e5af9612b68d6f6ab9def3f9c857f5485c4d5d WatchSource:0}: Error finding container 871e6255085cf7010c586c3ad0e5af9612b68d6f6ab9def3f9c857f5485c4d5d: Status 404 returned error can't find the container with id 871e6255085cf7010c586c3ad0e5af9612b68d6f6ab9def3f9c857f5485c4d5d Jun 09 14:37:01.925854 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.925803 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb013dbe_4faf_4cf6_91ed_47aa0ffa6d18.slice/crio-e761de7663f780ae618115b66b155964c92fe56c8c0f150d70beef84604deb96 WatchSource:0}: Error finding container e761de7663f780ae618115b66b155964c92fe56c8c0f150d70beef84604deb96: Status 404 returned error can't find the container with id e761de7663f780ae618115b66b155964c92fe56c8c0f150d70beef84604deb96 Jun 09 14:37:01.926905 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.926880 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae5f1f5_2dd1_48e0_951d_e2affc416875.slice/crio-46566d0eada6df098ee36c638bac303872c49594219acae3deb544b69cfaba13 WatchSource:0}: Error finding container 46566d0eada6df098ee36c638bac303872c49594219acae3deb544b69cfaba13: Status 404 returned error can't find the container with id 46566d0eada6df098ee36c638bac303872c49594219acae3deb544b69cfaba13 Jun 09 14:37:01.930812 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:01.930793 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda354512e_ca37_40df_a6ea_33f8b1930c59.slice/crio-dd4f0f2ccbc9c6e256a3875db33e0d8d978c1cd58c8cc48b9cc3b179f2df42cb WatchSource:0}: Error finding container dd4f0f2ccbc9c6e256a3875db33e0d8d978c1cd58c8cc48b9cc3b179f2df42cb: Status 404 returned error can't find the container with id dd4f0f2ccbc9c6e256a3875db33e0d8d978c1cd58c8cc48b9cc3b179f2df42cb Jun 09 14:37:02.037602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.037571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:02.037750 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.037673 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:02.047522 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.047489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9s9b" event={"ID":"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18","Type":"ContainerStarted","Data":"e761de7663f780ae618115b66b155964c92fe56c8c0f150d70beef84604deb96"} Jun 09 14:37:02.048610 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.048581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerStarted","Data":"46566d0eada6df098ee36c638bac303872c49594219acae3deb544b69cfaba13"} Jun 09 14:37:02.050509 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.050452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spdt2" event={"ID":"2cf5c8ec-8f16-4b80-9012-c2f211db2b98","Type":"ContainerStarted","Data":"871e6255085cf7010c586c3ad0e5af9612b68d6f6ab9def3f9c857f5485c4d5d"} Jun 09 14:37:02.052803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.052781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" event={"ID":"8037324e-1cf3-4be1-a3c9-e1bb842305cd","Type":"ContainerStarted","Data":"ecc20b5a30df0c9b58f8bbb0f3397ca6569b7ebb4549fda084933ac9a4ab3cc7"} Jun 09 14:37:02.053846 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.053822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv9dk" event={"ID":"18a5aaeb-a11e-4c31-882e-fd0fdb42de16","Type":"ContainerStarted","Data":"fbaf8e957e2153a6275fcc7b3e1d2b93a4b9bfc9a67e06c5dc4010632043ab30"} Jun 09 14:37:02.055621 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.055600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" event={"ID":"f940acdef2a382196cf29d0889dfafe1","Type":"ContainerStarted","Data":"7cea7618fb59a141d453fcb85e3f774625ddcb006792a5e4e1af4929fdbbdb58"} Jun 09 14:37:02.059931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.059907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nsvdz" event={"ID":"49567040-a90c-43a8-9cef-44956944a72a","Type":"ContainerStarted","Data":"5d1071855d27756bbbfecf2b5d7cf04a8957c344a044f95d299b2e2d090c588a"} Jun 09 14:37:02.064461 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.064419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5khd" event={"ID":"dd3c54ac-bdbd-4525-82a3-da998b922861","Type":"ContainerStarted","Data":"6c95192ee7f5ef6fea3f87c19df5b5d56f780eefebc160bc86e2ec8af56a47b9"} Jun 09 14:37:02.067624 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.067604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"cd263a6a8f6e534504eeb261a863adb654557a5708248d9a7841de4ffc9882b7"} Jun 09 14:37:02.069675 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.069642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55qlb" event={"ID":"a354512e-ca37-40df-a6ea-33f8b1930c59","Type":"ContainerStarted","Data":"dd4f0f2ccbc9c6e256a3875db33e0d8d978c1cd58c8cc48b9cc3b179f2df42cb"} Jun 09 14:37:02.138394 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.138358 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:32:01 +0000 UTC" deadline="2027-12-29 07:47:10.836499628 +0000 UTC" Jun 09 14:37:02.138394 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.138391 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13625h10m8.698113003s" Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.582770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.582826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.582898 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.582973 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.582952347 +0000 UTC m=+6.066227070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.582998 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:02.583372 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.583074 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.583034125 +0000 UTC m=+6.066308855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:02.684163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:02.684123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:02.684360 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.684336 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:02.684360 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.684356 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:02.684473 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.684369 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:02.684473 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:02.684430 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.684413597 +0000 UTC m=+6.167688320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:03.040456 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.040376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:03.040958 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:03.040522 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:03.040958 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.040931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:03.041078 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:03.041025 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:03.080274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.079062 2564 generic.go:356] "Generic (PLEG): container finished" podID="423066f5cca00fcfbe9555c22f22915b" containerID="9c199321d8e62944c7d96c34fe58e505f9406147732c0a51236535461bd1d95b" exitCode=0 Jun 09 14:37:03.080274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.080047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" event={"ID":"423066f5cca00fcfbe9555c22f22915b","Type":"ContainerDied","Data":"9c199321d8e62944c7d96c34fe58e505f9406147732c0a51236535461bd1d95b"} Jun 09 14:37:03.101928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.101565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-134.ec2.internal" podStartSLOduration=3.101544063 podStartE2EDuration="3.101544063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:02.070047087 +0000 UTC m=+3.553321824" watchObservedRunningTime="2026-06-09 14:37:03.101544063 +0000 UTC m=+4.584818801" Jun 09 14:37:03.139016 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.138957 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:32:01 +0000 UTC" deadline="2028-03-15 11:34:25.19989662 +0000 UTC" Jun 09 14:37:03.139016 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:03.138991 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15476h57m22.06090965s" Jun 09 14:37:04.037211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:04.037180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:04.037386 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.037312 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:04.105833 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:04.105786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" event={"ID":"423066f5cca00fcfbe9555c22f22915b","Type":"ContainerStarted","Data":"4b6562842ecf8ab90d6a407d310793500d8c4ec0c6974a7b435b25355076ebdc"} Jun 09 14:37:04.603409 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:04.603370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:04.603616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:04.603422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:04.603616 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.603571 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:04.603730 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.603634 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:08.603616159 +0000 UTC m=+10.086890880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:04.604059 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.604036 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:04.604191 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.604110 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:08.604077787 +0000 UTC m=+10.087352504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:04.706021 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:04.704471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:04.706021 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.704680 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:04.706021 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.704705 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:04.706021 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.704719 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:04.706021 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:04.704777 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:08.704756407 +0000 UTC m=+10.188031127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:05.038304 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:05.037809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:05.038304 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:05.037973 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:05.047290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:05.042590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:05.047290 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:05.042743 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:06.038238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:06.037774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:06.038238 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:06.037888 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:07.038791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:07.038209 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:07.038791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:07.038248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:07.038791 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:07.038351 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:07.038791 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:07.038743 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:08.037562 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:08.037527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:08.037821 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.037659 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:08.637288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:08.637247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:08.637704 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:08.637351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:08.637704 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.637408 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:08.637704 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.637461 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:08.637704 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.637480 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:16.637459385 +0000 UTC m=+18.120734113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:08.637704 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.637511 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:16.637495813 +0000 UTC m=+18.120770530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:08.737966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:08.737920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:08.738163 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.738071 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:08.738163 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.738108 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:08.738163 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.738121 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:08.738327 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:08.738180 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:16.738162754 +0000 UTC m=+18.221437471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:09.039732 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:09.039633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:09.039883 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:09.039736 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:09.040098 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:09.040059 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:09.040196 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:09.040167 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:10.038063 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:10.038026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:10.038533 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:10.038173 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:11.037257 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:11.037221 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:11.037453 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:11.037362 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:11.037453 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:11.037221 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:11.037557 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:11.037482 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:12.037219 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:12.037173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:12.037625 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:12.037330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:13.037950 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:13.037905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:13.038421 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:13.037967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:13.038421 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:13.038051 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:13.038421 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:13.038189 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:14.037683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:14.037646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:14.037849 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:14.037770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:15.040702 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:15.040674 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:15.041216 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:15.040804 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:15.041216 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:15.040852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:15.041216 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:15.040938 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:16.037480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:16.037447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:16.037692 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.037568 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:16.699623 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:16.699585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:16.699623 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:16.699631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:16.700124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.699735 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:16.700124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.699743 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:16.700124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.699798 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:32.699778774 +0000 UTC m=+34.183053515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:16.700124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.699818 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:32.699807975 +0000 UTC m=+34.183082691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:16.800981 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:16.800951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:16.801219 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.801197 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:16.801302 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.801226 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:16.801302 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.801240 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:16.801401 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:16.801305 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:32.801285986 +0000 UTC m=+34.284560721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:17.037433 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:17.037349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:17.037433 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:17.037395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:17.037648 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:17.037502 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:17.037705 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:17.037646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:18.037663 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:18.037627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:18.038104 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:18.037770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:19.038064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:19.038028 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:19.038496 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:19.038187 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:19.038496 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:19.038232 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:19.038496 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:19.038340 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:20.038015 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:20.037981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:20.038222 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:20.038128 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:21.037521 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.037149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:21.037521 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:21.037419 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:21.037521 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.037149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:21.037944 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:21.037830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:21.142893 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.142868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv9dk" event={"ID":"18a5aaeb-a11e-4c31-882e-fd0fdb42de16","Type":"ContainerStarted","Data":"cf8a54760c0d14a2a8249f5f2091dde61fcf78507b5dac06d39ee2ebdc18a211"} Jun 09 14:37:21.144612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.144583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nsvdz" event={"ID":"49567040-a90c-43a8-9cef-44956944a72a","Type":"ContainerStarted","Data":"5f880763b077eb8fa09666809704d13276328e914af76ac9ebf75bf77fb36ba7"} Jun 09 14:37:21.146254 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.146161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5khd" event={"ID":"dd3c54ac-bdbd-4525-82a3-da998b922861","Type":"ContainerStarted","Data":"ffa1a259866eaeae6b335c7afb575d70d4dddf1f3d0e6a70b7dfe2a3c9b68e27"} Jun 09 14:37:21.148579 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.148550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"9cd605bf3f80cd016382257a7edf548b1827ed8aceaf3cd72cd78a7d052d85bf"} Jun 09 14:37:21.148651 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.148639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"b0adc884d1800c36831d4b7fb8c04fdd91a08a48ac5bd96f33667c0295fd15c9"} Jun 09 14:37:21.151398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.151345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55qlb" event={"ID":"a354512e-ca37-40df-a6ea-33f8b1930c59","Type":"ContainerStarted","Data":"813221a8c0a2312b4a963ca60ede088656a4515f080f7e3cfc6c2f2957544f2c"} Jun 09 14:37:21.153263 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.153235 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="fbfa5cebfaf80f1854fe3f4106dec197eb837c90ebc7a12bdfb9ff15cae378f6" exitCode=0 Jun 09 14:37:21.153373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.153317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"fbfa5cebfaf80f1854fe3f4106dec197eb837c90ebc7a12bdfb9ff15cae378f6"} Jun 09 14:37:21.154996 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.154966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spdt2" event={"ID":"2cf5c8ec-8f16-4b80-9012-c2f211db2b98","Type":"ContainerStarted","Data":"4ac2275d1a74d3be612550a8412fb74bf02082f379e2e82f7a306fab78b91a72"} Jun 09 14:37:21.157019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.156997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" event={"ID":"8037324e-1cf3-4be1-a3c9-e1bb842305cd","Type":"ContainerStarted","Data":"f2b492b268a99b07b1d83f44595f35568bae83bf32c7a6bc498dda6a73d3f91f"} Jun 09 14:37:21.165675 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.165628 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-134.ec2.internal" podStartSLOduration=21.165615621 podStartE2EDuration="21.165615621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:04.121296826 +0000 UTC m=+5.604571567" watchObservedRunningTime="2026-06-09 14:37:21.165615621 +0000 UTC m=+22.648890360" Jun 09 14:37:21.166042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.166021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jv9dk" podStartSLOduration=3.620770996 podStartE2EDuration="22.166014133s" totalImagesPullingTime="18.545243137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:21.165124843 +0000 UTC m=+22.648399585" watchObservedRunningTime="2026-06-09 14:37:21.166014133 +0000 UTC m=+22.649288870" Jun 09 14:37:21.183241 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.183196 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nsvdz" podStartSLOduration=8.060431757 podStartE2EDuration="22.183184799s" totalImagesPullingTime="14.122753042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:21.183157909 +0000 UTC m=+22.666432647" watchObservedRunningTime="2026-06-09 14:37:21.183184799 +0000 UTC m=+22.666459536" Jun 09 14:37:21.250926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.250878 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-55qlb" podStartSLOduration=3.380269373 podStartE2EDuration="22.250855581s" totalImagesPullingTime="18.870586208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:21.215528943 +0000 UTC m=+22.698803678" watchObservedRunningTime="2026-06-09 14:37:21.250855581 +0000 UTC m=+22.734130310" Jun 09 14:37:21.275059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:21.275020 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v5khd" podStartSLOduration=3.432888778 podStartE2EDuration="22.275006572s" totalImagesPullingTime="18.842117794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:21.274609432 +0000 UTC m=+22.757884169" watchObservedRunningTime="2026-06-09 14:37:21.275006572 +0000 UTC m=+22.758281309" Jun 09 14:37:22.037893 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.037846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:22.038075 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:22.037978 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:22.164442 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.164408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"308c4f59d340697129fed9758114b285c874917006babb9b062a21bf936f41ab"} Jun 09 14:37:22.164783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.164498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"bebd020219420b4f10ea92903201eb3140b9231deb964cd422732bbd75d9b52c"} Jun 09 14:37:22.164783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.164540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"5d1d2e377417b89c15f908b7c59e098f3fb2cf25063d16476164df68fc43dc46"} Jun 09 14:37:22.164783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.164572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"e7a9ff0c9a68dd516252d5a4807bd2fcf25bd81355149f5cf956cef1b18f5029"} Jun 09 14:37:22.264395 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.264370 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 14:37:22.978911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.978875 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:22.979741 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:22.979595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:23.007232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.007179 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-spdt2" podStartSLOduration=9.874844321 podStartE2EDuration="24.007158068s" totalImagesPullingTime="14.132313747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:21.298882332 +0000 UTC m=+22.782157070" watchObservedRunningTime="2026-06-09 14:37:23.007158068 +0000 UTC m=+24.490432810" Jun 09 14:37:23.037218 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.037186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:23.037375 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.037186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:23.037375 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:23.037353 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:23.037486 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:23.037407 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:23.042307 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.042212 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T14:37:22.264390571Z","UUID":"7073572e-0c8e-4961-b084-0f624e078781","Handler":null,"Name":"","Endpoint":""} Jun 09 14:37:23.043984 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.043963 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 14:37:23.044114 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.044006 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 14:37:23.169043 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.168986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" event={"ID":"8037324e-1cf3-4be1-a3c9-e1bb842305cd","Type":"ContainerStarted","Data":"1a0f86f2954c3895b4050eb83c9a32aa549304c984fe2cd29d3732f427b26faf"} Jun 09 14:37:23.169429 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.169054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" event={"ID":"8037324e-1cf3-4be1-a3c9-e1bb842305cd","Type":"ContainerStarted","Data":"fa9605912df0f0149bfd0318ec9019e05b6d192940e89ee37d9c9f59656d4dcb"} Jun 09 14:37:23.171114 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.171058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9s9b" event={"ID":"fb013dbe-4faf-4cf6-91ed-47aa0ffa6d18","Type":"ContainerStarted","Data":"da3629fb0e4f2493480db871b36dd824bdee01c20bd79488db0cedc0b529afd0"} Jun 09 14:37:23.203984 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:23.203924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cbtlb" podStartSLOduration=3.4483951409999998 podStartE2EDuration="24.203908987s" totalImagesPullingTime="20.755513846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.203688568 +0000 UTC m=+24.686963307" watchObservedRunningTime="2026-06-09 14:37:23.203908987 +0000 UTC m=+24.687183725" Jun 09 14:37:24.037322 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:24.037289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:24.037504 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:24.037403 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:24.177551 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:24.177517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"a1753707c6a2a08848334000ff0238f4a46d9693ea191d708cf1c01155db0b43"} Jun 09 14:37:24.178114 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:24.177534 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 14:37:25.037513 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.037474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:25.037703 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:25.037612 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:25.037703 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.037681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:25.037817 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:25.037792 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:25.464725 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.464681 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:25.465500 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.464791 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 14:37:25.465500 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.465332 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-spdt2" Jun 09 14:37:25.484619 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:25.484575 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t9s9b" podStartSLOduration=7.63440137 podStartE2EDuration="26.4845578s" totalImagesPullingTime="18.85015643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.229555649 +0000 UTC m=+24.712830378" watchObservedRunningTime="2026-06-09 14:37:25.4845578 +0000 UTC m=+26.967832538" Jun 09 14:37:26.037622 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:26.037547 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:26.037757 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:26.037637 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:26.183237 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:26.183203 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="17b8b482b336e657e4380b167ef2d5d36409fde5c3d0f311819ca373b0ccdeb3" exitCode=0 Jun 09 14:37:26.183406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:26.183282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"17b8b482b336e657e4380b167ef2d5d36409fde5c3d0f311819ca373b0ccdeb3"} Jun 09 14:37:26.186980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:26.186956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" event={"ID":"3f0d3c17-8ac7-4e72-b9d0-2301a8bd5854","Type":"ContainerStarted","Data":"d03f14f97192771775ee92f76df1c32cf4860df53c48a5790b8a81f71ef9d7b0"} Jun 09 14:37:26.267400 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:26.267352 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" podStartSLOduration=8.370152562 podStartE2EDuration="27.267336601s" totalImagesPullingTime="18.897184039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:26.266881318 +0000 UTC m=+27.750156048" watchObservedRunningTime="2026-06-09 14:37:26.267336601 +0000 UTC m=+27.750611352" Jun 09 14:37:27.037386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.037345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:27.037987 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.037360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:27.037987 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:27.037480 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:27.037987 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:27.037551 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:27.189776 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.189750 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:27.189972 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.189835 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:27.189972 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.189887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:27.205772 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.205746 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:27.205934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:27.205858 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:37:28.037672 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.037633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:28.038133 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:28.037745 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:28.123142 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.123111 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7swzz"] Jun 09 14:37:28.123294 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.123226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:28.123351 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:28.123332 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:28.133148 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.133121 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-98jnq"] Jun 09 14:37:28.133324 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.133216 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:28.133324 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:28.133306 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:28.133817 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.133796 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znl82"] Jun 09 14:37:28.193688 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.193506 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="6a8f304e2deb405314cd00ee9665b4ad53b35b9909fcb20b1ef52d5d2a13f878" exitCode=0 Jun 09 14:37:28.193881 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.193586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"6a8f304e2deb405314cd00ee9665b4ad53b35b9909fcb20b1ef52d5d2a13f878"} Jun 09 14:37:28.193881 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:28.193745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:28.193881 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:28.193824 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:30.037991 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:30.037889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:30.038542 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:30.037898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:30.038542 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:30.038014 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:30.038542 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:30.038035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:30.038542 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:30.038146 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:30.038542 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:30.038253 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:30.199446 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:30.199416 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="3003d52f681e2c4d03b653445709baacdc4ae2888bc9e945498cc9af77a8e371" exitCode=0 Jun 09 14:37:30.199613 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:30.199457 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"3003d52f681e2c4d03b653445709baacdc4ae2888bc9e945498cc9af77a8e371"} Jun 09 14:37:32.037273 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.037237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:32.037273 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.037267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:32.037952 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.037268 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:32.037952 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.037364 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:37:32.037952 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.037436 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znl82" podUID="0177362c-e8a9-47c0-a195-4a1b53401fc8" Jun 09 14:37:32.037952 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.037516 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-98jnq" podUID="9f63f1d9-a2c5-4055-884c-d1afa5277fc8" Jun 09 14:37:32.717858 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.717819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:32.717858 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.717865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:32.718124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.717990 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:32.718124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.717990 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:32.718124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.718049 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:04.718030494 +0000 UTC m=+66.201305212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:32.718124 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.718066 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret podName:0177362c-e8a9-47c0-a195-4a1b53401fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:04.718057638 +0000 UTC m=+66.201332354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret") pod "global-pull-secret-syncer-znl82" (UID: "0177362c-e8a9-47c0-a195-4a1b53401fc8") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:32.818845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.818806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:32.819030 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.818981 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:32.819030 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.819002 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:32.819030 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.819012 2564 projected.go:196] Error preparing data for projected volume kube-api-access-mmlnm for pod openshift-network-diagnostics/network-check-target-98jnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:32.819208 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:32.819066 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm podName:9f63f1d9-a2c5-4055-884c-d1afa5277fc8 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:04.819048512 +0000 UTC m=+66.302323242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmlnm" (UniqueName: "kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm") pod "network-check-target-98jnq" (UID: "9f63f1d9-a2c5-4055-884c-d1afa5277fc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:32.836116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.836044 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-134.ec2.internal" event="NodeReady" Jun 09 14:37:32.836289 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.836208 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 14:37:32.871868 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.871837 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:37:32.896116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.895368 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2bkw"] Jun 09 14:37:32.896116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.895469 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:32.898261 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.898229 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 14:37:32.898413 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.898326 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 14:37:32.898413 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.898334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 14:37:32.898413 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.898405 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xxjlx\"" Jun 09 14:37:32.911882 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.911400 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 14:37:32.913625 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.913601 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26dn6"] Jun 09 14:37:32.913745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.913725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:32.916172 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.916148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 14:37:32.916279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.916194 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 14:37:32.916279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.916163 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 14:37:32.916372 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.916326 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cr592\"" Jun 09 14:37:32.929169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.929148 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:37:32.929279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.929179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2bkw"] Jun 09 14:37:32.929279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.929200 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26dn6"] Jun 09 14:37:32.929378 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.929287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:32.932157 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.932127 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 14:37:32.932157 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.932143 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 14:37:32.932344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:32.932324 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w2kzc\"" Jun 09 14:37:33.020411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrz2\" (UniqueName: \"kubernetes.io/projected/89bf9679-28fb-427f-84c0-4b38f59e6126-kube-api-access-vdrz2\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.020411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghtlx\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741376eb-5d5f-48b1-9cd6-40ff6587e737-cert\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.020749 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkssw\" (UniqueName: \"kubernetes.io/projected/741376eb-5d5f-48b1-9cd6-40ff6587e737-kube-api-access-fkssw\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.021131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bf9679-28fb-427f-84c0-4b38f59e6126-tmp-dir\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.021131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.021131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.021131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.020852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89bf9679-28fb-427f-84c0-4b38f59e6126-config-volume\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.121665 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrz2\" (UniqueName: \"kubernetes.io/projected/89bf9679-28fb-427f-84c0-4b38f59e6126-kube-api-access-vdrz2\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtlx\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741376eb-5d5f-48b1-9cd6-40ff6587e737-cert\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.121974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkssw\" (UniqueName: \"kubernetes.io/projected/741376eb-5d5f-48b1-9cd6-40ff6587e737-kube-api-access-fkssw\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bf9679-28fb-427f-84c0-4b38f59e6126-tmp-dir\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.122106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89bf9679-28fb-427f-84c0-4b38f59e6126-config-volume\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.122228 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.122249 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.122318 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:33.622297919 +0000 UTC m=+35.105572636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:33.122581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122914 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.122914 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bf9679-28fb-427f-84c0-4b38f59e6126-tmp-dir\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.122914 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.122791 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:33.122914 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.122851 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:33.622832866 +0000 UTC m=+35.106107584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:33.123129 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.122990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.123129 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.123014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89bf9679-28fb-427f-84c0-4b38f59e6126-config-volume\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.127053 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.126882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.127263 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.127245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.127336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.127272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741376eb-5d5f-48b1-9cd6-40ff6587e737-cert\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.135638 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.135615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrz2\" (UniqueName: \"kubernetes.io/projected/89bf9679-28fb-427f-84c0-4b38f59e6126-kube-api-access-vdrz2\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.135977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.135948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghtlx\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.136408 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.136384 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.136980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.136962 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkssw\" (UniqueName: \"kubernetes.io/projected/741376eb-5d5f-48b1-9cd6-40ff6587e737-kube-api-access-fkssw\") pod \"ingress-canary-x2bkw\" (UID: \"741376eb-5d5f-48b1-9cd6-40ff6587e737\") " pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.223609 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.223578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2bkw" Jun 09 14:37:33.625697 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.625656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:33.625988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:33.625711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:33.625988 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.625818 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:33.625988 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.625821 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:33.625988 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.625838 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:33.625988 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.625885 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:34.625865023 +0000 UTC m=+36.109139742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:33.626295 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:33.626277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:34.625893952 +0000 UTC m=+36.109168670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:34.037643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.037564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:37:34.037643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.037603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:37:34.037643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.037603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:37:34.041357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041303 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:37:34.041357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ddm5r\"" Jun 09 14:37:34.041357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041303 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:37:34.041357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041303 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:37:34.042931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:37:34.042931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.041303 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n68j\"" Jun 09 14:37:34.428102 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.428006 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2bkw"] Jun 09 14:37:34.520597 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:37:34.520567 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741376eb_5d5f_48b1_9cd6_40ff6587e737.slice/crio-94fc7ebbadccae4096e6fb8341ba3d99b44f789f11e670febf152786badc96a2 WatchSource:0}: Error finding container 94fc7ebbadccae4096e6fb8341ba3d99b44f789f11e670febf152786badc96a2: Status 404 returned error can't find the container with id 94fc7ebbadccae4096e6fb8341ba3d99b44f789f11e670febf152786badc96a2 Jun 09 14:37:34.633988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.633960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:34.634160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:34.634072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:34.634160 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:34.634128 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:34.634160 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:34.634146 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:34.634298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:34.634170 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:34.634298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:34.634200 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:36.634185357 +0000 UTC m=+38.117460073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:34.634298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:34.634218 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:36.634206566 +0000 UTC m=+38.117481285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:35.214983 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:35.214938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2bkw" event={"ID":"741376eb-5d5f-48b1-9cd6-40ff6587e737","Type":"ContainerStarted","Data":"94fc7ebbadccae4096e6fb8341ba3d99b44f789f11e670febf152786badc96a2"} Jun 09 14:37:35.218107 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:35.218059 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="cfb5b59fbdea43fe51700e0aaf6f93652887957543d91d2d3a084fa5dd44caa7" exitCode=0 Jun 09 14:37:35.218222 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:35.218126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"cfb5b59fbdea43fe51700e0aaf6f93652887957543d91d2d3a084fa5dd44caa7"} Jun 09 14:37:36.224655 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.224624 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ae5f1f5-2dd1-48e0-951d-e2affc416875" containerID="08d63bbb66baf8484eaa84544ba0391a1180a1e1e32e3e143c297ec567bb6364" exitCode=0 Jun 09 14:37:36.225125 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.224701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerDied","Data":"08d63bbb66baf8484eaa84544ba0391a1180a1e1e32e3e143c297ec567bb6364"} Jun 09 14:37:36.226364 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.226240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2bkw" event={"ID":"741376eb-5d5f-48b1-9cd6-40ff6587e737","Type":"ContainerStarted","Data":"e606e818903dc14a7d2e8256aef0645c9487caf7078b5117e93a6ac3afffed80"} Jun 09 14:37:36.267940 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.267436 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2bkw" podStartSLOduration=2.6742532690000003 podStartE2EDuration="4.267412691s" totalImagesPullingTime="1.593159422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:36.266189499 +0000 UTC m=+37.749464238" watchObservedRunningTime="2026-06-09 14:37:36.267412691 +0000 UTC m=+37.750687430" Jun 09 14:37:36.649691 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.649646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:36.649691 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:36.649702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:36.649980 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:36.649820 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:36.649980 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:36.649887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:40.649872251 +0000 UTC m=+42.133146967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:36.649980 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:36.649825 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:36.649980 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:36.649940 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:36.649980 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:36.649983 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:40.649971778 +0000 UTC m=+42.133246514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:37.231519 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:37.231482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-86wdz" event={"ID":"1ae5f1f5-2dd1-48e0-951d-e2affc416875","Type":"ContainerStarted","Data":"a6279c0fce5501bc53b7c52817df43d81ec9635c36f690ef65ea774c270a2961"} Jun 09 14:37:37.262366 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:37.262313 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-86wdz" podStartSLOduration=8.297731223 podStartE2EDuration="38.262299477s" totalImagesPullingTime="29.964568254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:37.260763822 +0000 UTC m=+38.744038560" watchObservedRunningTime="2026-06-09 14:37:37.262299477 +0000 UTC m=+38.745574217" Jun 09 14:37:40.678991 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:40.678946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:40.679007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:40.679126 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:40.679134 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:40.679151 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:40.679201 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:48.67918353 +0000 UTC m=+50.162458250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:40.679582 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:40.679217 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:48.679209549 +0000 UTC m=+50.162484266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:48.744832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:48.744787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:37:48.744832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:48.744841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:37:48.745298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:48.744963 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:48.745298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:48.745042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:04.745024857 +0000 UTC m=+66.228299572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:37:48.745298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:48.744967 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:37:48.745298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:48.745070 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:37:48.745298 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:37:48.745137 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:04.74512574 +0000 UTC m=+66.228400455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:37:59.213437 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:37:59.213402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qssn" Jun 09 14:38:04.766039 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.765990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:38:04.766039 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.766040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.766064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.766108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.766194 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.766208 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.766257 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:36.766243831 +0000 UTC m=+98.249518548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.766258 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:38:04.766543 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.766334 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:36.766316623 +0000 UTC m=+98.249591341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:38:04.769261 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.769241 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:38:04.769349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.769272 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:38:04.777240 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.777221 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:38:04.777311 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:04.777265 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:39:08.777252894 +0000 UTC m=+130.260527610 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : secret "metrics-daemon-secret" not found Jun 09 14:38:04.780552 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.780531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0177362c-e8a9-47c0-a195-4a1b53401fc8-original-pull-secret\") pod \"global-pull-secret-syncer-znl82\" (UID: \"0177362c-e8a9-47c0-a195-4a1b53401fc8\") " pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:38:04.866881 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.866832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:38:04.869771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.869746 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:38:04.880281 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.880252 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:38:04.891175 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.891144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmlnm\" (UniqueName: \"kubernetes.io/projected/9f63f1d9-a2c5-4055-884c-d1afa5277fc8-kube-api-access-mmlnm\") pod \"network-check-target-98jnq\" (UID: \"9f63f1d9-a2c5-4055-884c-d1afa5277fc8\") " pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:38:04.959987 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.959957 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ddm5r\"" Jun 09 14:38:04.963428 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.963410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znl82" Jun 09 14:38:04.968308 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:04.968282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:38:05.105417 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:05.105388 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znl82"] Jun 09 14:38:05.108594 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:38:05.108548 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0177362c_e8a9_47c0_a195_4a1b53401fc8.slice/crio-463fc59529cf6386ac37a0197169d3f7e0497872cfacce033d41775e7740bc71 WatchSource:0}: Error finding container 463fc59529cf6386ac37a0197169d3f7e0497872cfacce033d41775e7740bc71: Status 404 returned error can't find the container with id 463fc59529cf6386ac37a0197169d3f7e0497872cfacce033d41775e7740bc71 Jun 09 14:38:05.119160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:05.119136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-98jnq"] Jun 09 14:38:05.121732 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:38:05.121700 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f63f1d9_a2c5_4055_884c_d1afa5277fc8.slice/crio-f07acece42ad0d6170602632b28051c88a9225aa08e7201b44215cd7cd55a2ea WatchSource:0}: Error finding container f07acece42ad0d6170602632b28051c88a9225aa08e7201b44215cd7cd55a2ea: Status 404 returned error can't find the container with id f07acece42ad0d6170602632b28051c88a9225aa08e7201b44215cd7cd55a2ea Jun 09 14:38:05.295968 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:05.295877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-98jnq" event={"ID":"9f63f1d9-a2c5-4055-884c-d1afa5277fc8","Type":"ContainerStarted","Data":"f07acece42ad0d6170602632b28051c88a9225aa08e7201b44215cd7cd55a2ea"} Jun 09 14:38:05.296946 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:05.296914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znl82" event={"ID":"0177362c-e8a9-47c0-a195-4a1b53401fc8","Type":"ContainerStarted","Data":"463fc59529cf6386ac37a0197169d3f7e0497872cfacce033d41775e7740bc71"} Jun 09 14:38:10.311426 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:10.311393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znl82" event={"ID":"0177362c-e8a9-47c0-a195-4a1b53401fc8","Type":"ContainerStarted","Data":"92f4bf51c67cdb0bb1e4d47184214cff7e35a19754c8d6ae3aa842b23ad41299"} Jun 09 14:38:10.312783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:10.312757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-98jnq" event={"ID":"9f63f1d9-a2c5-4055-884c-d1afa5277fc8","Type":"ContainerStarted","Data":"c53ee7266521614afe8045cd78e6c7497ba024b912bf03d6e9fd33f2840defc1"} Jun 09 14:38:10.312974 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:10.312954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:38:10.327064 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:10.327020 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-znl82" podStartSLOduration=67.082663567 podStartE2EDuration="1m11.327006123s" totalImagesPullingTime="4.244342556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:38:10.326475421 +0000 UTC m=+71.809750158" watchObservedRunningTime="2026-06-09 14:38:10.327006123 +0000 UTC m=+71.810280860" Jun 09 14:38:10.342598 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:10.342545 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-98jnq" podStartSLOduration=67.116486989 podStartE2EDuration="1m11.342529436s" totalImagesPullingTime="4.226042447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:38:10.34181123 +0000 UTC m=+71.825085968" watchObservedRunningTime="2026-06-09 14:38:10.342529436 +0000 UTC m=+71.825804173" Jun 09 14:38:36.792401 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:36.792353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:36.792433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:36.792508 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:36.792518 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:36.792531 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:36.792574 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:39:40.792561622 +0000 UTC m=+162.275836337 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:38:36.792886 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:38:36.792587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:39:40.79258143 +0000 UTC m=+162.275856145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:38:41.317486 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:38:41.317448 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-98jnq" Jun 09 14:39:08.820060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:08.820007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:39:08.820578 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:08.820193 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:39:08.820578 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:08.820274 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs podName:1ada3f09-e116-4309-8c2c-5138f9c62af3 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:10.820256795 +0000 UTC m=+252.303531511 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs") pod "network-metrics-daemon-7swzz" (UID: "1ada3f09-e116-4309-8c2c-5138f9c62af3") : secret "metrics-daemon-secret" not found Jun 09 14:39:35.909874 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:35.909817 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" podUID="5256d114-df22-4eb1-866b-046302c3c940" Jun 09 14:39:35.938787 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:35.938753 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-26dn6" podUID="89bf9679-28fb-427f-84c0-4b38f59e6126" Jun 09 14:39:36.515697 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:36.515664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:39:37.049436 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:37.049399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7swzz" podUID="1ada3f09-e116-4309-8c2c-5138f9c62af3" Jun 09 14:39:40.858538 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:40.858489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:40.858561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:40.858647 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:40.858649 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:40.858668 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-546fcddb96-vzcgq: secret "image-registry-tls" not found Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:40.858705 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls podName:89bf9679-28fb-427f-84c0-4b38f59e6126 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:42.858691167 +0000 UTC m=+284.341965882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls") pod "dns-default-26dn6" (UID: "89bf9679-28fb-427f-84c0-4b38f59e6126") : secret "dns-default-metrics-tls" not found Jun 09 14:39:40.858947 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:39:40.858721 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls podName:5256d114-df22-4eb1-866b-046302c3c940 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:42.858712221 +0000 UTC m=+284.341986937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls") pod "image-registry-546fcddb96-vzcgq" (UID: "5256d114-df22-4eb1-866b-046302c3c940") : secret "image-registry-tls" not found Jun 09 14:39:51.037986 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:51.037954 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26dn6" Jun 09 14:39:52.037394 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:39:52.037339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:40:48.459839 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.459783 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-dgkpj"] Jun 09 14:40:48.461608 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.461583 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc"] Jun 09 14:40:48.462312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.462293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.463150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.463132 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f"] Jun 09 14:40:48.463253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.463235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" Jun 09 14:40:48.465052 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.465028 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2"] Jun 09 14:40:48.465184 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.465164 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.465964 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.465945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lrn5v\"" Jun 09 14:40:48.466699 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.466613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.466813 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.466702 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.468626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.468607 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 14:40:48.468626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.468620 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.468788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.468728 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.469340 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.469325 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rkd72\"" Jun 09 14:40:48.472052 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.472031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 14:40:48.472176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.472159 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 14:40:48.472345 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.472328 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 14:40:48.472887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.472870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-82hdw\"" Jun 09 14:40:48.473595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.473551 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5gf7n\"" Jun 09 14:40:48.473701 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.473627 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 14:40:48.478745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.478725 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.480267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.480249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 14:40:48.489909 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.489889 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2"] Jun 09 14:40:48.519593 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.519557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dgkpj"] Jun 09 14:40:48.520364 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.520340 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc"] Jun 09 14:40:48.523653 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.523627 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f"] Jun 09 14:40:48.545953 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.545928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-tmp\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546081 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.545972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-snapshots\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546081 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.545990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7krz2\" (UniqueName: \"kubernetes.io/projected/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-kube-api-access-7krz2\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546081 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-trusted-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546081 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.546267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-serving-cert\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.546267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918ed93e-33d5-4b54-b715-01e49cf6e2bf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.546267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvh4\" (UniqueName: \"kubernetes.io/projected/bd0dfc8b-296d-4908-8f93-dd7953a598ee-kube-api-access-hcvh4\") pod \"network-check-source-dbd9cf844-qjmpc\" (UID: \"bd0dfc8b-296d-4908-8f93-dd7953a598ee\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" Jun 09 14:40:48.546267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-service-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.546435 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.546269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppl59\" (UniqueName: \"kubernetes.io/projected/d7b0899c-cd15-43b4-b220-a5ee072b56b6-kube-api-access-ppl59\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.556160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.556136 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp"] Jun 09 14:40:48.557816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.557800 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs"] Jun 09 14:40:48.557932 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.557916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" Jun 09 14:40:48.559279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.559261 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf"] Jun 09 14:40:48.559392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.559375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.560755 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.560739 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-h59n4"] Jun 09 14:40:48.560833 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.560786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.561062 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.561047 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.561154 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.561054 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.561585 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.561558 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hscjv\"" Jun 09 14:40:48.562057 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.562023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 14:40:48.562157 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.562060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k8hdj\"" Jun 09 14:40:48.562157 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.562060 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.562269 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.562244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.562558 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.562540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.565990 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.565971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 14:40:48.566115 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.566001 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 14:40:48.566194 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.566119 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.566357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.566341 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9n9v\"" Jun 09 14:40:48.566403 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.566394 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.567006 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.566991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 14:40:48.567104 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.567066 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:40:48.567165 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.567102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 14:40:48.567165 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.567073 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 14:40:48.567273 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.567258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dgmsg\"" Jun 09 14:40:48.568934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.568607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 14:40:48.573911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.573818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs"] Jun 09 14:40:48.574808 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.574788 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp"] Jun 09 14:40:48.575551 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.575528 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 14:40:48.576685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.576012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf"] Jun 09 14:40:48.577218 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.577197 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-h59n4"] Jun 09 14:40:48.647406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-snapshots\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.647406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67c9p\" (UniqueName: \"kubernetes.io/projected/2c13f034-0ed2-411b-8d07-b6b365f65ad2-kube-api-access-67c9p\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.647635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-serving-cert\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.647635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-trusted-ca\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.647635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.647635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrt6g\" (UniqueName: \"kubernetes.io/projected/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-kube-api-access-xrt6g\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.647635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-service-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7p5z\" (UniqueName: \"kubernetes.io/projected/64a92861-a7e1-4446-bbea-121a194da0e8-kube-api-access-x7p5z\") pod \"volume-data-source-validator-78dd696465-n94xp\" (UID: \"64a92861-a7e1-4446-bbea-121a194da0e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7krz2\" (UniqueName: \"kubernetes.io/projected/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-kube-api-access-7krz2\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.647854 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:40:48.647869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-trusted-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918ed93e-33d5-4b54-b715-01e49cf6e2bf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvh4\" (UniqueName: \"kubernetes.io/projected/bd0dfc8b-296d-4908-8f93-dd7953a598ee-kube-api-access-hcvh4\") pod \"network-check-source-dbd9cf844-qjmpc\" (UID: \"bd0dfc8b-296d-4908-8f93-dd7953a598ee\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-config\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-serving-cert\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.647982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwqw\" (UniqueName: \"kubernetes.io/projected/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-kube-api-access-dbwqw\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c13f034-0ed2-411b-8d07-b6b365f65ad2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-snapshots\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648196 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.648149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:40:49.14812803 +0000 UTC m=+230.631402754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppl59\" (UniqueName: \"kubernetes.io/projected/d7b0899c-cd15-43b4-b220-a5ee072b56b6-kube-api-access-ppl59\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-service-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-tmp\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.648530 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 14:40:48.648658 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.648592 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls podName:d7b0899c-cd15-43b4-b220-a5ee072b56b6 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:49.148577217 +0000 UTC m=+230.631851937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ddq6f" (UID: "d7b0899c-cd15-43b4-b220-a5ee072b56b6") : secret "samples-operator-tls" not found Jun 09 14:40:48.648840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-tmp\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648694 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-trusted-ca-bundle\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.648840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.648754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/918ed93e-33d5-4b54-b715-01e49cf6e2bf-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:48.650063 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.650047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-serving-cert\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.663414 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.663393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7krz2\" (UniqueName: \"kubernetes.io/projected/83bcf2c9-5f45-4659-97d3-9aa3b30804cb-kube-api-access-7krz2\") pod \"insights-operator-896549976-dgkpj\" (UID: \"83bcf2c9-5f45-4659-97d3-9aa3b30804cb\") " pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.663732 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.663709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvh4\" (UniqueName: \"kubernetes.io/projected/bd0dfc8b-296d-4908-8f93-dd7953a598ee-kube-api-access-hcvh4\") pod \"network-check-source-dbd9cf844-qjmpc\" (UID: \"bd0dfc8b-296d-4908-8f93-dd7953a598ee\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" Jun 09 14:40:48.663785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.663729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppl59\" (UniqueName: \"kubernetes.io/projected/d7b0899c-cd15-43b4-b220-a5ee072b56b6-kube-api-access-ppl59\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:48.749135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67c9p\" (UniqueName: \"kubernetes.io/projected/2c13f034-0ed2-411b-8d07-b6b365f65ad2-kube-api-access-67c9p\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.749135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-trusted-ca\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.749135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrt6g\" (UniqueName: \"kubernetes.io/projected/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-kube-api-access-xrt6g\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7p5z\" (UniqueName: \"kubernetes.io/projected/64a92861-a7e1-4446-bbea-121a194da0e8-kube-api-access-x7p5z\") pod \"volume-data-source-validator-78dd696465-n94xp\" (UID: \"64a92861-a7e1-4446-bbea-121a194da0e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.749219 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-config\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-serving-cert\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:48.749292 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:49.249276557 +0000 UTC m=+230.732551273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwqw\" (UniqueName: \"kubernetes.io/projected/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-kube-api-access-dbwqw\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.749411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c13f034-0ed2-411b-8d07-b6b365f65ad2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.749958 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.749934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.750030 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.750013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-trusted-ca\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.750168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.750148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c13f034-0ed2-411b-8d07-b6b365f65ad2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.750252 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.750235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-config\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.752234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.752212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.752333 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.752263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-serving-cert\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.758054 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.758005 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwqw\" (UniqueName: \"kubernetes.io/projected/b2db5a4b-aca6-49b2-82d9-a51ed82657e0-kube-api-access-dbwqw\") pod \"console-operator-668fdbf85c-h59n4\" (UID: \"b2db5a4b-aca6-49b2-82d9-a51ed82657e0\") " pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.758416 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.758398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrt6g\" (UniqueName: \"kubernetes.io/projected/2dee6e07-33ad-4a5d-b643-654c0e20e9bd-kube-api-access-xrt6g\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kpsrs\" (UID: \"2dee6e07-33ad-4a5d-b643-654c0e20e9bd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.759069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.759050 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7p5z\" (UniqueName: \"kubernetes.io/projected/64a92861-a7e1-4446-bbea-121a194da0e8-kube-api-access-x7p5z\") pod \"volume-data-source-validator-78dd696465-n94xp\" (UID: \"64a92861-a7e1-4446-bbea-121a194da0e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" Jun 09 14:40:48.759176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.759157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67c9p\" (UniqueName: \"kubernetes.io/projected/2c13f034-0ed2-411b-8d07-b6b365f65ad2-kube-api-access-67c9p\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:48.773013 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.772992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dgkpj" Jun 09 14:40:48.779398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.779376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" Jun 09 14:40:48.868574 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.868544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" Jun 09 14:40:48.880957 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.880899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" Jun 09 14:40:48.892427 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.892399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:48.918077 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.917967 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dgkpj"] Jun 09 14:40:48.920726 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:48.920696 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bcf2c9_5f45_4659_97d3_9aa3b30804cb.slice/crio-6608837f4534dbf3466d307eaa2335e48aab25b08d3a4b0e70bcdc8f2651280c WatchSource:0}: Error finding container 6608837f4534dbf3466d307eaa2335e48aab25b08d3a4b0e70bcdc8f2651280c: Status 404 returned error can't find the container with id 6608837f4534dbf3466d307eaa2335e48aab25b08d3a4b0e70bcdc8f2651280c Jun 09 14:40:48.932253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:48.932178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc"] Jun 09 14:40:49.036392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.036349 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp"] Jun 09 14:40:49.038887 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:49.038860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a92861_a7e1_4446_bbea_121a194da0e8.slice/crio-1212a3fa8bed21b96124dd6f244f2e41973a7c14f2853e78ce92bc4c1d5a6f6d WatchSource:0}: Error finding container 1212a3fa8bed21b96124dd6f244f2e41973a7c14f2853e78ce92bc4c1d5a6f6d: Status 404 returned error can't find the container with id 1212a3fa8bed21b96124dd6f244f2e41973a7c14f2853e78ce92bc4c1d5a6f6d Jun 09 14:40:49.057760 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.057733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs"] Jun 09 14:40:49.064997 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:49.064967 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dee6e07_33ad_4a5d_b643_654c0e20e9bd.slice/crio-081e1b05b013987df8569de8e1b7f1ef956b14cb247de5bab0908337651cc27c WatchSource:0}: Error finding container 081e1b05b013987df8569de8e1b7f1ef956b14cb247de5bab0908337651cc27c: Status 404 returned error can't find the container with id 081e1b05b013987df8569de8e1b7f1ef956b14cb247de5bab0908337651cc27c Jun 09 14:40:49.076726 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.076697 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-h59n4"] Jun 09 14:40:49.080583 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:49.080561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2db5a4b_aca6_49b2_82d9_a51ed82657e0.slice/crio-6ddb7be160357916925498a821b17bacf9e520c4ee5c72611d0faf83556ea99c WatchSource:0}: Error finding container 6ddb7be160357916925498a821b17bacf9e520c4ee5c72611d0faf83556ea99c: Status 404 returned error can't find the container with id 6ddb7be160357916925498a821b17bacf9e520c4ee5c72611d0faf83556ea99c Jun 09 14:40:49.152711 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.152680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:49.152869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.152751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:49.152869 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.152848 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:40:49.152935 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.152928 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:40:50.152906341 +0000 UTC m=+231.636181072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:40:49.152983 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.152853 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 14:40:49.152983 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.152980 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls podName:d7b0899c-cd15-43b4-b220-a5ee072b56b6 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:50.152968254 +0000 UTC m=+231.636242969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ddq6f" (UID: "d7b0899c-cd15-43b4-b220-a5ee072b56b6") : secret "samples-operator-tls" not found Jun 09 14:40:49.253750 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.253646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:49.253900 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.253819 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:49.253945 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:49.253901 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:50.253881154 +0000 UTC m=+231.737155871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:49.689670 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.689625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" event={"ID":"64a92861-a7e1-4446-bbea-121a194da0e8","Type":"ContainerStarted","Data":"1212a3fa8bed21b96124dd6f244f2e41973a7c14f2853e78ce92bc4c1d5a6f6d"} Jun 09 14:40:49.691539 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.691479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" event={"ID":"2dee6e07-33ad-4a5d-b643-654c0e20e9bd","Type":"ContainerStarted","Data":"081e1b05b013987df8569de8e1b7f1ef956b14cb247de5bab0908337651cc27c"} Jun 09 14:40:49.694214 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.693463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" event={"ID":"bd0dfc8b-296d-4908-8f93-dd7953a598ee","Type":"ContainerStarted","Data":"a3e85c01456c81369f738820295ae27ac95648ea6a7d60bd03efd7f2821d37f3"} Jun 09 14:40:49.694214 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.693511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" event={"ID":"bd0dfc8b-296d-4908-8f93-dd7953a598ee","Type":"ContainerStarted","Data":"477a7620f67b3c421e2369ab938f44cd8e2caa205601ba8deebc407797e53b55"} Jun 09 14:40:49.696940 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.696913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dgkpj" event={"ID":"83bcf2c9-5f45-4659-97d3-9aa3b30804cb","Type":"ContainerStarted","Data":"6608837f4534dbf3466d307eaa2335e48aab25b08d3a4b0e70bcdc8f2651280c"} Jun 09 14:40:49.699238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.699188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" event={"ID":"b2db5a4b-aca6-49b2-82d9-a51ed82657e0","Type":"ContainerStarted","Data":"6ddb7be160357916925498a821b17bacf9e520c4ee5c72611d0faf83556ea99c"} Jun 09 14:40:49.711917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:49.711368 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qjmpc" podStartSLOduration=1.7113504160000002 podStartE2EDuration="1.711350416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:49.710654956 +0000 UTC m=+231.193929687" watchObservedRunningTime="2026-06-09 14:40:49.711350416 +0000 UTC m=+231.194625157" Jun 09 14:40:50.163632 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:50.163339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:50.163632 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:50.163439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:50.163632 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.163570 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:40:50.163632 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.163642 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:40:52.163622796 +0000 UTC m=+233.646897515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:40:50.163992 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.163725 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 14:40:50.163992 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.163803 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls podName:d7b0899c-cd15-43b4-b220-a5ee072b56b6 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:52.163786216 +0000 UTC m=+233.647060937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ddq6f" (UID: "d7b0899c-cd15-43b4-b220-a5ee072b56b6") : secret "samples-operator-tls" not found Jun 09 14:40:50.264787 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:50.264652 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:50.264959 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.264829 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:50.264959 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:50.264922 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:52.264901554 +0000 UTC m=+233.748176272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:50.704295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:50.704212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" event={"ID":"64a92861-a7e1-4446-bbea-121a194da0e8","Type":"ContainerStarted","Data":"d4b0cd9c4deca4000c0ac8347bab3bd69461d8399d86875b30bf30aed745e2d5"} Jun 09 14:40:50.721873 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:50.721821 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n94xp" podStartSLOduration=1.4117524000000001 podStartE2EDuration="2.721803047s" totalImagesPullingTime="1.310050647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:50.721160785 +0000 UTC m=+232.204435524" watchObservedRunningTime="2026-06-09 14:40:50.721803047 +0000 UTC m=+232.205077785" Jun 09 14:40:52.181834 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.181798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:52.182345 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.181871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:52.182345 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.181943 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 14:40:52.182345 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.182018 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls podName:d7b0899c-cd15-43b4-b220-a5ee072b56b6 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:56.181998591 +0000 UTC m=+237.665273309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ddq6f" (UID: "d7b0899c-cd15-43b4-b220-a5ee072b56b6") : secret "samples-operator-tls" not found Jun 09 14:40:52.182345 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.181952 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:40:52.182345 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.182100 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:40:56.182066502 +0000 UTC m=+237.665341234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:40:52.282403 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.282366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:52.282548 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.282504 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:52.282594 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:52.282569 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:40:56.282554989 +0000 UTC m=+237.765829706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:52.710867 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.710827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dgkpj" event={"ID":"83bcf2c9-5f45-4659-97d3-9aa3b30804cb","Type":"ContainerStarted","Data":"4fda7ac90e526175b9004593bfd0f4c4fcdb782195f522019ad74fcbbe31cd4d"} Jun 09 14:40:52.712599 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.712576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/0.log" Jun 09 14:40:52.712704 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.712619 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" containerID="b95e8d52d5133e60406a3e9c1b3e29dc701689c9d413f400b959732af69a21e4" exitCode=255 Jun 09 14:40:52.712753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.712705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" event={"ID":"b2db5a4b-aca6-49b2-82d9-a51ed82657e0","Type":"ContainerDied","Data":"b95e8d52d5133e60406a3e9c1b3e29dc701689c9d413f400b959732af69a21e4"} Jun 09 14:40:52.712872 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.712857 2564 scope.go:117] "RemoveContainer" containerID="b95e8d52d5133e60406a3e9c1b3e29dc701689c9d413f400b959732af69a21e4" Jun 09 14:40:52.714119 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.714077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" event={"ID":"2dee6e07-33ad-4a5d-b643-654c0e20e9bd","Type":"ContainerStarted","Data":"7078ec7f3a0c2b184ab9cb367d9815a49e9f2fa12ad2c3f0acf0011a9aeb8d0e"} Jun 09 14:40:52.729408 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.729359 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-dgkpj" podStartSLOduration=1.57499853 podStartE2EDuration="4.729339212s" totalImagesPullingTime="3.154340682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:52.728316102 +0000 UTC m=+234.211590864" watchObservedRunningTime="2026-06-09 14:40:52.729339212 +0000 UTC m=+234.212613950" Jun 09 14:40:52.750317 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:52.750265 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" podStartSLOduration=1.745043412 podStartE2EDuration="4.750243888s" totalImagesPullingTime="3.005200476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:52.748872548 +0000 UTC m=+234.232147287" watchObservedRunningTime="2026-06-09 14:40:52.750243888 +0000 UTC m=+234.233518631" Jun 09 14:40:53.718937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.718907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/1.log" Jun 09 14:40:53.719479 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.719322 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/0.log" Jun 09 14:40:53.719479 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.719364 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" exitCode=255 Jun 09 14:40:53.719479 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.719447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" event={"ID":"b2db5a4b-aca6-49b2-82d9-a51ed82657e0","Type":"ContainerDied","Data":"6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004"} Jun 09 14:40:53.719625 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.719508 2564 scope.go:117] "RemoveContainer" containerID="b95e8d52d5133e60406a3e9c1b3e29dc701689c9d413f400b959732af69a21e4" Jun 09 14:40:53.719788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:53.719759 2564 scope.go:117] "RemoveContainer" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" Jun 09 14:40:53.719983 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:53.719961 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-h59n4_openshift-console-operator(b2db5a4b-aca6-49b2-82d9-a51ed82657e0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podUID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" Jun 09 14:40:54.130106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.130057 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg"] Jun 09 14:40:54.132622 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.132603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" Jun 09 14:40:54.135551 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.135530 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 14:40:54.135673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.135596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dd7xf\"" Jun 09 14:40:54.135854 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.135837 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 14:40:54.149150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.149124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg"] Jun 09 14:40:54.300105 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.300064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbvm\" (UniqueName: \"kubernetes.io/projected/4e1c3ad1-61ab-4d48-a805-fdb323e4716d-kube-api-access-zqbvm\") pod \"migrator-955ffdf5f-dpfhg\" (UID: \"4e1c3ad1-61ab-4d48-a805-fdb323e4716d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" Jun 09 14:40:54.400710 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.400612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbvm\" (UniqueName: \"kubernetes.io/projected/4e1c3ad1-61ab-4d48-a805-fdb323e4716d-kube-api-access-zqbvm\") pod \"migrator-955ffdf5f-dpfhg\" (UID: \"4e1c3ad1-61ab-4d48-a805-fdb323e4716d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" Jun 09 14:40:54.410412 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.410381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbvm\" (UniqueName: \"kubernetes.io/projected/4e1c3ad1-61ab-4d48-a805-fdb323e4716d-kube-api-access-zqbvm\") pod \"migrator-955ffdf5f-dpfhg\" (UID: \"4e1c3ad1-61ab-4d48-a805-fdb323e4716d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" Jun 09 14:40:54.441238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.441210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" Jun 09 14:40:54.459448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.459415 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ztmkv"] Jun 09 14:40:54.461374 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.461356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.464417 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.464389 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 14:40:54.464417 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.464410 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 14:40:54.464589 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.464470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 14:40:54.464589 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.464544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fz8fj\"" Jun 09 14:40:54.464705 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.464653 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 14:40:54.475177 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.475151 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ztmkv"] Jun 09 14:40:54.570760 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.570729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg"] Jun 09 14:40:54.573434 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:54.573406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1c3ad1_61ab_4d48_a805_fdb323e4716d.slice/crio-33ddd7cb8c42b64f8e563088d89bbad4a513f85fd14fa2874be78deff7370ab6 WatchSource:0}: Error finding container 33ddd7cb8c42b64f8e563088d89bbad4a513f85fd14fa2874be78deff7370ab6: Status 404 returned error can't find the container with id 33ddd7cb8c42b64f8e563088d89bbad4a513f85fd14fa2874be78deff7370ab6 Jun 09 14:40:54.602606 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.602577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-key\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.602747 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.602706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdnq9\" (UniqueName: \"kubernetes.io/projected/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-kube-api-access-xdnq9\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.602812 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.602780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-cabundle\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.704158 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.704044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnq9\" (UniqueName: \"kubernetes.io/projected/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-kube-api-access-xdnq9\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.704158 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.704153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-cabundle\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.704350 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.704196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-key\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.704855 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.704835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-cabundle\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.706746 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.706723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-signing-key\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.712617 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.712593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnq9\" (UniqueName: \"kubernetes.io/projected/c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b-kube-api-access-xdnq9\") pod \"service-ca-7d74d578b8-ztmkv\" (UID: \"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b\") " pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.724609 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.724593 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/1.log" Jun 09 14:40:54.724987 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.724970 2564 scope.go:117] "RemoveContainer" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" Jun 09 14:40:54.725187 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:54.725164 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-h59n4_openshift-console-operator(b2db5a4b-aca6-49b2-82d9-a51ed82657e0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podUID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" Jun 09 14:40:54.725765 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.725735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" event={"ID":"4e1c3ad1-61ab-4d48-a805-fdb323e4716d","Type":"ContainerStarted","Data":"33ddd7cb8c42b64f8e563088d89bbad4a513f85fd14fa2874be78deff7370ab6"} Jun 09 14:40:54.771348 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.771317 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" Jun 09 14:40:54.895211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:54.895185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-ztmkv"] Jun 09 14:40:54.897532 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:40:54.897509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6007684_fc67_45aa_8ee5_f0b3fd9f5e5b.slice/crio-6176e31923f21d4da767ec6c412da1a45ee75bb16ce82b67018c7cfd1551a37a WatchSource:0}: Error finding container 6176e31923f21d4da767ec6c412da1a45ee75bb16ce82b67018c7cfd1551a37a: Status 404 returned error can't find the container with id 6176e31923f21d4da767ec6c412da1a45ee75bb16ce82b67018c7cfd1551a37a Jun 09 14:40:55.645239 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:55.645207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nsvdz_49567040-a90c-43a8-9cef-44956944a72a/dns-node-resolver/0.log" Jun 09 14:40:55.731499 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:55.731460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" event={"ID":"4e1c3ad1-61ab-4d48-a805-fdb323e4716d","Type":"ContainerStarted","Data":"0c4395925405235c897bc8780226e71b789f737dc0c927563e8ff76945bc40c6"} Jun 09 14:40:55.731973 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:55.731565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" event={"ID":"4e1c3ad1-61ab-4d48-a805-fdb323e4716d","Type":"ContainerStarted","Data":"9daf2fe23e2bd437155fa8854699607fa09e3f6e0dfd07b2f7d78f3b7acb55b4"} Jun 09 14:40:55.732777 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:55.732746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" event={"ID":"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b","Type":"ContainerStarted","Data":"6176e31923f21d4da767ec6c412da1a45ee75bb16ce82b67018c7cfd1551a37a"} Jun 09 14:40:55.753920 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:55.753818 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-dpfhg" podStartSLOduration=0.83949418 podStartE2EDuration="1.753795689s" totalImagesPullingTime="914.301509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:55.751708999 +0000 UTC m=+237.234983738" watchObservedRunningTime="2026-06-09 14:40:55.753795689 +0000 UTC m=+237.237070428" Jun 09 14:40:56.217993 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:56.217951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:40:56.218210 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:56.218055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:40:56.218210 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.218134 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:40:56.218210 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.218169 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 14:40:56.218332 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.218213 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:41:04.218193672 +0000 UTC m=+245.701468391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:40:56.218332 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.218232 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls podName:d7b0899c-cd15-43b4-b220-a5ee072b56b6 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:04.218223044 +0000 UTC m=+245.701497761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ddq6f" (UID: "d7b0899c-cd15-43b4-b220-a5ee072b56b6") : secret "samples-operator-tls" not found Jun 09 14:40:56.318694 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:56.318655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:40:56.318888 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.318816 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:56.318935 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:56.318892 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:04.318871498 +0000 UTC m=+245.802146230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:40:56.644606 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:56.644575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv9dk_18a5aaeb-a11e-4c31-882e-fd0fdb42de16/node-ca/0.log" Jun 09 14:40:57.643574 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:57.643547 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2bkw_741376eb-5d5f-48b1-9cd6-40ff6587e737/serve-healthcheck-canary/0.log" Jun 09 14:40:57.741667 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:57.741639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" event={"ID":"c6007684-fc67-45aa-8ee5-f0b3fd9f5e5b","Type":"ContainerStarted","Data":"a3a31ff5df4533aa1d551aee78555490b8ac22bbc04aa79a84ebbd0db29017c4"} Jun 09 14:40:57.759557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:57.759506 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-ztmkv" podStartSLOduration=1.783359194 podStartE2EDuration="3.759489234s" totalImagesPullingTime="1.97613004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:40:57.759162064 +0000 UTC m=+239.242436804" watchObservedRunningTime="2026-06-09 14:40:57.759489234 +0000 UTC m=+239.242763972" Jun 09 14:40:58.893549 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:58.893517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:58.893983 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:58.893572 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:40:58.893983 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:40:58.893915 2564 scope.go:117] "RemoveContainer" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" Jun 09 14:40:58.894138 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:40:58.894073 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-h59n4_openshift-console-operator(b2db5a4b-aca6-49b2-82d9-a51ed82657e0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podUID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" Jun 09 14:41:04.283334 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.283284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:41:04.283713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.283362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:41:04.283713 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:04.283467 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 14:41:04.283713 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:04.283523 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert podName:918ed93e-33d5-4b54-b715-01e49cf6e2bf nodeName:}" failed. No retries permitted until 2026-06-09 14:41:20.283508784 +0000 UTC m=+261.766783500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rmrb2" (UID: "918ed93e-33d5-4b54-b715-01e49cf6e2bf") : secret "networking-console-plugin-cert" not found Jun 09 14:41:04.285978 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.285957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b0899c-cd15-43b4-b220-a5ee072b56b6-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ddq6f\" (UID: \"d7b0899c-cd15-43b4-b220-a5ee072b56b6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:41:04.384105 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.384058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:41:04.384268 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:04.384205 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 14:41:04.384309 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:04.384279 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls podName:2c13f034-0ed2-411b-8d07-b6b365f65ad2 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:20.384259017 +0000 UTC m=+261.867533737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-hwbpf" (UID: "2c13f034-0ed2-411b-8d07-b6b365f65ad2") : secret "cluster-monitoring-operator-tls" not found Jun 09 14:41:04.387549 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.387515 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5gf7n\"" Jun 09 14:41:04.394514 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.394487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" Jun 09 14:41:04.522829 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.522787 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f"] Jun 09 14:41:04.768055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:04.768018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" event={"ID":"d7b0899c-cd15-43b4-b220-a5ee072b56b6","Type":"ContainerStarted","Data":"f74a310ce409b7409bb5308199177410b64f9c776d21165d48ae7ed9de2a5bce"} Jun 09 14:41:06.777524 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:06.777484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" event={"ID":"d7b0899c-cd15-43b4-b220-a5ee072b56b6","Type":"ContainerStarted","Data":"e86e46c4fd33b0188674dbdf604e68cf1bea06dae44d960ae4e5c2e5622380ee"} Jun 09 14:41:06.777934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:06.777553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" event={"ID":"d7b0899c-cd15-43b4-b220-a5ee072b56b6","Type":"ContainerStarted","Data":"eba5eaf0cdbe79b5b2b5478f29ff94d875b836930dc2105bb0af4b5b57eed153"} Jun 09 14:41:06.800916 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:06.800862 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ddq6f" podStartSLOduration=17.396956141 podStartE2EDuration="18.800841553s" totalImagesPullingTime="1.403885412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:06.799938931 +0000 UTC m=+248.283213669" watchObservedRunningTime="2026-06-09 14:41:06.800841553 +0000 UTC m=+248.284116293" Jun 09 14:41:10.834683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:10.834629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:41:10.837047 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:10.837015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ada3f09-e116-4309-8c2c-5138f9c62af3-metrics-certs\") pod \"network-metrics-daemon-7swzz\" (UID: \"1ada3f09-e116-4309-8c2c-5138f9c62af3\") " pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:41:10.940666 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:10.940635 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n68j\"" Jun 09 14:41:10.948762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:10.948742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7swzz" Jun 09 14:41:11.080666 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:11.080629 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7swzz"] Jun 09 14:41:11.083601 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:11.083570 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ada3f09_e116_4309_8c2c_5138f9c62af3.slice/crio-3fcd2ebd8f631e5913244615c55e45aa76418d40a512228681283ef7cf085c86 WatchSource:0}: Error finding container 3fcd2ebd8f631e5913244615c55e45aa76418d40a512228681283ef7cf085c86: Status 404 returned error can't find the container with id 3fcd2ebd8f631e5913244615c55e45aa76418d40a512228681283ef7cf085c86 Jun 09 14:41:11.795182 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:11.795144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7swzz" event={"ID":"1ada3f09-e116-4309-8c2c-5138f9c62af3","Type":"ContainerStarted","Data":"3fcd2ebd8f631e5913244615c55e45aa76418d40a512228681283ef7cf085c86"} Jun 09 14:41:12.037510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.037480 2564 scope.go:117] "RemoveContainer" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" Jun 09 14:41:12.800116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.800067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7swzz" event={"ID":"1ada3f09-e116-4309-8c2c-5138f9c62af3","Type":"ContainerStarted","Data":"0da45a4d81bcf53fcd4dbf5c50f169f0907dc10781fdf289b50bedc2e7fbe782"} Jun 09 14:41:12.800280 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.800131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7swzz" event={"ID":"1ada3f09-e116-4309-8c2c-5138f9c62af3","Type":"ContainerStarted","Data":"ed377eb3c0aa8236d7e7a406c9c5d4767c9d40f4575f050aea769757c01e2543"} Jun 09 14:41:12.801541 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.801523 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:41:12.801900 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.801884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/1.log" Jun 09 14:41:12.801946 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.801916 2564 generic.go:356] "Generic (PLEG): container finished" podID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" containerID="102c684fe651b019eeb4417603ef8b553a0ca4d52f1ca9e3d070f592ad6e6d02" exitCode=255 Jun 09 14:41:12.801980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.801951 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" event={"ID":"b2db5a4b-aca6-49b2-82d9-a51ed82657e0","Type":"ContainerDied","Data":"102c684fe651b019eeb4417603ef8b553a0ca4d52f1ca9e3d070f592ad6e6d02"} Jun 09 14:41:12.802018 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.801980 2564 scope.go:117] "RemoveContainer" containerID="6eb911325c539b0a2b7132c410846f20bd0d830ee8357e928ad2a55ab07cf004" Jun 09 14:41:12.802294 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.802277 2564 scope.go:117] "RemoveContainer" containerID="102c684fe651b019eeb4417603ef8b553a0ca4d52f1ca9e3d070f592ad6e6d02" Jun 09 14:41:12.802438 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:12.802422 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-h59n4_openshift-console-operator(b2db5a4b-aca6-49b2-82d9-a51ed82657e0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podUID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" Jun 09 14:41:12.817912 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:12.817865 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7swzz" podStartSLOduration=253.01141905 podStartE2EDuration="4m13.817848335s" totalImagesPullingTime="806.429285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:12.817193371 +0000 UTC m=+254.300468107" watchObservedRunningTime="2026-06-09 14:41:12.817848335 +0000 UTC m=+254.301123074" Jun 09 14:41:13.806697 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:13.806670 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:41:16.116715 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.116674 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vzq89"] Jun 09 14:41:16.121368 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.121343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.124363 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.124337 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 14:41:16.124894 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.124876 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 14:41:16.125285 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.125267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghppp\"" Jun 09 14:41:16.161845 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.161783 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vzq89"] Jun 09 14:41:16.178909 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.178845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0347449-9991-4187-8119-ab35a8618604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.179134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.178922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzzs\" (UniqueName: \"kubernetes.io/projected/f0347449-9991-4187-8119-ab35a8618604-kube-api-access-bwzzs\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.179134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.178953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0347449-9991-4187-8119-ab35a8618604-data-volume\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.179134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.179019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0347449-9991-4187-8119-ab35a8618604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.179134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.179058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0347449-9991-4187-8119-ab35a8618604-crio-socket\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.279727 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.279697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0347449-9991-4187-8119-ab35a8618604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.279931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.279755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0347449-9991-4187-8119-ab35a8618604-crio-socket\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.279931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.279811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0347449-9991-4187-8119-ab35a8618604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.279931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.279918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0347449-9991-4187-8119-ab35a8618604-crio-socket\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.280112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.279964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzzs\" (UniqueName: \"kubernetes.io/projected/f0347449-9991-4187-8119-ab35a8618604-kube-api-access-bwzzs\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.280112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.280003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0347449-9991-4187-8119-ab35a8618604-data-volume\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.280272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.280252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0347449-9991-4187-8119-ab35a8618604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.280349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.280330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0347449-9991-4187-8119-ab35a8618604-data-volume\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.282341 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.282317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0347449-9991-4187-8119-ab35a8618604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.293134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.293114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzzs\" (UniqueName: \"kubernetes.io/projected/f0347449-9991-4187-8119-ab35a8618604-kube-api-access-bwzzs\") pod \"insights-runtime-extractor-vzq89\" (UID: \"f0347449-9991-4187-8119-ab35a8618604\") " pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.430335 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.430250 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vzq89" Jun 09 14:41:16.559396 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.559363 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vzq89"] Jun 09 14:41:16.562359 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:16.562327 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0347449_9991_4187_8119_ab35a8618604.slice/crio-7a2077c803c4f8732012f41abf119d119a3ec0b6800f97db5fa3155f39e4c15b WatchSource:0}: Error finding container 7a2077c803c4f8732012f41abf119d119a3ec0b6800f97db5fa3155f39e4c15b: Status 404 returned error can't find the container with id 7a2077c803c4f8732012f41abf119d119a3ec0b6800f97db5fa3155f39e4c15b Jun 09 14:41:16.820290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.820199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzq89" event={"ID":"f0347449-9991-4187-8119-ab35a8618604","Type":"ContainerStarted","Data":"8bc54bf863143f2ad301e7fe979daacbc104b5f3e06406ee8dae3c2ce8d1c299"} Jun 09 14:41:16.820290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:16.820254 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzq89" event={"ID":"f0347449-9991-4187-8119-ab35a8618604","Type":"ContainerStarted","Data":"7a2077c803c4f8732012f41abf119d119a3ec0b6800f97db5fa3155f39e4c15b"} Jun 09 14:41:17.826590 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:17.826553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzq89" event={"ID":"f0347449-9991-4187-8119-ab35a8618604","Type":"ContainerStarted","Data":"29ca4fd3c1714f57d2cc13685e62e97428113c39ae08290aa5b48df24e434aa2"} Jun 09 14:41:18.832078 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:18.831993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vzq89" event={"ID":"f0347449-9991-4187-8119-ab35a8618604","Type":"ContainerStarted","Data":"aa6274a0a01136ed7dc8b1acc1b2dc2bd19e8db305b483f1023e9057765b4dd7"} Jun 09 14:41:18.851687 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:18.851639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vzq89" podStartSLOduration=1.02457339 podStartE2EDuration="2.85162262s" totalImagesPullingTime="1.82704923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:41:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:18.850051653 +0000 UTC m=+260.333326390" watchObservedRunningTime="2026-06-09 14:41:18.85162262 +0000 UTC m=+260.334897358" Jun 09 14:41:18.892546 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:18.892517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:41:18.892669 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:18.892579 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:41:18.892871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:18.892859 2564 scope.go:117] "RemoveContainer" containerID="102c684fe651b019eeb4417603ef8b553a0ca4d52f1ca9e3d070f592ad6e6d02" Jun 09 14:41:18.893018 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:18.893000 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-h59n4_openshift-console-operator(b2db5a4b-aca6-49b2-82d9-a51ed82657e0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podUID="b2db5a4b-aca6-49b2-82d9-a51ed82657e0" Jun 09 14:41:20.315721 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.315679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:41:20.318196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.318161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/918ed93e-33d5-4b54-b715-01e49cf6e2bf-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rmrb2\" (UID: \"918ed93e-33d5-4b54-b715-01e49cf6e2bf\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:41:20.416567 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.416513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:41:20.418999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.418976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c13f034-0ed2-411b-8d07-b6b365f65ad2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-hwbpf\" (UID: \"2c13f034-0ed2-411b-8d07-b6b365f65ad2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:41:20.592370 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.592278 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-82hdw\"" Jun 09 14:41:20.599648 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.599629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" Jun 09 14:41:20.689541 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.689515 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9n9v\"" Jun 09 14:41:20.697689 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.697661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" Jun 09 14:41:20.728965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.728938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2"] Jun 09 14:41:20.731141 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:20.731114 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918ed93e_33d5_4b54_b715_01e49cf6e2bf.slice/crio-08f23bf4c1f6596e4a7b0cb8dc6f9f6af4c8616dae67d2daabbf6c55bf42699d WatchSource:0}: Error finding container 08f23bf4c1f6596e4a7b0cb8dc6f9f6af4c8616dae67d2daabbf6c55bf42699d: Status 404 returned error can't find the container with id 08f23bf4c1f6596e4a7b0cb8dc6f9f6af4c8616dae67d2daabbf6c55bf42699d Jun 09 14:41:20.826031 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.825992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf"] Jun 09 14:41:20.828676 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:20.828652 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c13f034_0ed2_411b_8d07_b6b365f65ad2.slice/crio-1a2c85120b9ecb83e014fee9adf0a30249c1d93fcc1b8928747b61a139ec616f WatchSource:0}: Error finding container 1a2c85120b9ecb83e014fee9adf0a30249c1d93fcc1b8928747b61a139ec616f: Status 404 returned error can't find the container with id 1a2c85120b9ecb83e014fee9adf0a30249c1d93fcc1b8928747b61a139ec616f Jun 09 14:41:20.838781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.838753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" event={"ID":"2c13f034-0ed2-411b-8d07-b6b365f65ad2","Type":"ContainerStarted","Data":"1a2c85120b9ecb83e014fee9adf0a30249c1d93fcc1b8928747b61a139ec616f"} Jun 09 14:41:20.839811 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:20.839785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" event={"ID":"918ed93e-33d5-4b54-b715-01e49cf6e2bf","Type":"ContainerStarted","Data":"08f23bf4c1f6596e4a7b0cb8dc6f9f6af4c8616dae67d2daabbf6c55bf42699d"} Jun 09 14:41:22.848956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:22.848858 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" event={"ID":"2c13f034-0ed2-411b-8d07-b6b365f65ad2","Type":"ContainerStarted","Data":"f24a93a12c0525dae4b856883856585b0d9e40cc9a9ed7d96b3a07e7df60aefb"} Jun 09 14:41:22.850374 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:22.850347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" event={"ID":"918ed93e-33d5-4b54-b715-01e49cf6e2bf","Type":"ContainerStarted","Data":"dd5749df764f08396940e3a34cf9a18f5f479e023b2fcf6b04c6430a2dae1382"} Jun 09 14:41:22.868664 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:22.868609 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-hwbpf" podStartSLOduration=33.234660941 podStartE2EDuration="34.868589347s" totalImagesPullingTime="1.633928406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:22.866773027 +0000 UTC m=+264.350047766" watchObservedRunningTime="2026-06-09 14:41:22.868589347 +0000 UTC m=+264.351864086" Jun 09 14:41:22.883391 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:22.883339 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rmrb2" podStartSLOduration=33.156180714 podStartE2EDuration="34.88332363s" totalImagesPullingTime="1.727142916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:22.882169971 +0000 UTC m=+264.365444709" watchObservedRunningTime="2026-06-09 14:41:22.88332363 +0000 UTC m=+264.366598370" Jun 09 14:41:29.418385 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.418341 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl"] Jun 09 14:41:29.421746 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.421726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.424776 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.424742 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 14:41:29.424915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.424779 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q9b6g\"" Jun 09 14:41:29.425822 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.425802 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 14:41:29.425897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.425814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 14:41:29.441799 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.441769 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f"] Jun 09 14:41:29.444205 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.444181 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl"] Jun 09 14:41:29.444331 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.444303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.449367 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.449346 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 14:41:29.449881 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.449864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 14:41:29.451857 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.451839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b2w9v\"" Jun 09 14:41:29.458595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.458577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 14:41:29.481622 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.481592 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f"] Jun 09 14:41:29.487242 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.487213 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-js2xt"] Jun 09 14:41:29.489808 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.489786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.491238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.491214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06063208-30c8-41fb-9058-97ae11515552-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.491375 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.491264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.491375 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.491349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62845\" (UniqueName: \"kubernetes.io/projected/06063208-30c8-41fb-9058-97ae11515552-kube-api-access-62845\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.491489 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.491421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.493100 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.493065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 14:41:29.493215 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.493133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r2dxb\"" Jun 09 14:41:29.493480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.493464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 14:41:29.493572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.493555 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 14:41:29.591748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-textfile\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-root\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06063208-30c8-41fb-9058-97ae11515552-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-tls\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.591999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.591960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-sys\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-wtmp\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/720aa010-43e2-41ea-858c-e68c72ed09d0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4zwz\" (UniqueName: \"kubernetes.io/projected/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-kube-api-access-b4zwz\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s684s\" (UniqueName: \"kubernetes.io/projected/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-api-access-s684s\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62845\" (UniqueName: \"kubernetes.io/projected/06063208-30c8-41fb-9058-97ae11515552-kube-api-access-62845\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.592926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-metrics-client-ca\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.592926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.592926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.592531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06063208-30c8-41fb-9058-97ae11515552-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.594840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.594816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.595382 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.595360 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06063208-30c8-41fb-9058-97ae11515552-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.600858 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.600827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62845\" (UniqueName: \"kubernetes.io/projected/06063208-30c8-41fb-9058-97ae11515552-kube-api-access-62845\") pod \"openshift-state-metrics-65f78d5c66-sz5pl\" (UID: \"06063208-30c8-41fb-9058-97ae11515552\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.693965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.693873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-sys\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.693965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.693914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-wtmp\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.693965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.693934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.693965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.693953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/720aa010-43e2-41ea-858c-e68c72ed09d0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.693974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-sys\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-wtmp\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4zwz\" (UniqueName: \"kubernetes.io/projected/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-kube-api-access-b4zwz\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s684s\" (UniqueName: \"kubernetes.io/projected/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-api-access-s684s\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-metrics-client-ca\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-textfile\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-root\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-tls\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694454 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/720aa010-43e2-41ea-858c-e68c72ed09d0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694574 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-root\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.694752 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-textfile\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.695349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.694792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.695349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.695032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.695616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.695445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.695616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.695461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-metrics-client-ca\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.696805 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.696777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.696905 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.696788 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.696948 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.696921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-node-exporter-tls\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.697170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.697152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.704135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.704110 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4zwz\" (UniqueName: \"kubernetes.io/projected/d02fa7f5-1f00-44c4-aa84-cc1028c470f2-kube-api-access-b4zwz\") pod \"node-exporter-js2xt\" (UID: \"d02fa7f5-1f00-44c4-aa84-cc1028c470f2\") " pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.704398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.704380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s684s\" (UniqueName: \"kubernetes.io/projected/720aa010-43e2-41ea-858c-e68c72ed09d0-kube-api-access-s684s\") pod \"kube-state-metrics-57bbf8bfb5-vjt2f\" (UID: \"720aa010-43e2-41ea-858c-e68c72ed09d0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.733191 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.733152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" Jun 09 14:41:29.754966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.754935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" Jun 09 14:41:29.806202 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.800079 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-js2xt" Jun 09 14:41:29.814343 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:29.814306 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02fa7f5_1f00_44c4_aa84_cc1028c470f2.slice/crio-28cc9ffff63d6173205d436a10decfc9ad88a7cdf364724b6d03b8ce9b1347da WatchSource:0}: Error finding container 28cc9ffff63d6173205d436a10decfc9ad88a7cdf364724b6d03b8ce9b1347da: Status 404 returned error can't find the container with id 28cc9ffff63d6173205d436a10decfc9ad88a7cdf364724b6d03b8ce9b1347da Jun 09 14:41:29.874440 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.874402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js2xt" event={"ID":"d02fa7f5-1f00-44c4-aa84-cc1028c470f2","Type":"ContainerStarted","Data":"28cc9ffff63d6173205d436a10decfc9ad88a7cdf364724b6d03b8ce9b1347da"} Jun 09 14:41:29.883593 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.883555 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl"] Jun 09 14:41:29.884678 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:29.884650 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06063208_30c8_41fb_9058_97ae11515552.slice/crio-7c3ede6bad96c9d112f1a7327795f13f01e5454395c9bf21d9285b4fee54f823 WatchSource:0}: Error finding container 7c3ede6bad96c9d112f1a7327795f13f01e5454395c9bf21d9285b4fee54f823: Status 404 returned error can't find the container with id 7c3ede6bad96c9d112f1a7327795f13f01e5454395c9bf21d9285b4fee54f823 Jun 09 14:41:29.903449 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:29.903420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f"] Jun 09 14:41:29.914171 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:29.914144 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720aa010_43e2_41ea_858c_e68c72ed09d0.slice/crio-ea0aa83c7e5980772bb0317c7166982d6b730ea91362e7818265582beaf6d8b4 WatchSource:0}: Error finding container ea0aa83c7e5980772bb0317c7166982d6b730ea91362e7818265582beaf6d8b4: Status 404 returned error can't find the container with id ea0aa83c7e5980772bb0317c7166982d6b730ea91362e7818265582beaf6d8b4 Jun 09 14:41:30.447293 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.444829 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:41:30.449332 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.449306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.452968 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.452367 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 14:41:30.452968 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.452810 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 14:41:30.453180 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.453019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 14:41:30.453278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.453239 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.453435 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.453665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.454006 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.454305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.454490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 14:41:30.455791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.454672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stjpp\"" Jun 09 14:41:30.463956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.463923 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:41:30.603209 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ltrf\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.603722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.603652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.704969 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.704882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.704969 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.704934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.704969 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.704962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.704993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ltrf\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705682 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.705682 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.705329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.706785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.706759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.707051 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.707023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.709805 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.709777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.713638 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.713611 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.713730 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.713703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.713784 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.713728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.714204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.714170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.714695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.714599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.715480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.715282 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.715580 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.715561 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.715821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.715750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.715977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.715903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.718303 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.718279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ltrf\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf\") pod \"alertmanager-main-0\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.765903 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.765869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:41:30.881726 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.881683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" event={"ID":"720aa010-43e2-41ea-858c-e68c72ed09d0","Type":"ContainerStarted","Data":"ea0aa83c7e5980772bb0317c7166982d6b730ea91362e7818265582beaf6d8b4"} Jun 09 14:41:30.884238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.884210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" event={"ID":"06063208-30c8-41fb-9058-97ae11515552","Type":"ContainerStarted","Data":"ef8390586ef66b8d292146f99c9eded3c18d8ff6860c9c6f0cecaa1b0c1a4aa8"} Jun 09 14:41:30.884389 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.884272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" event={"ID":"06063208-30c8-41fb-9058-97ae11515552","Type":"ContainerStarted","Data":"7b43474c9b0b4bd67e287bb9b263c7418e363d0add1e092934874d62c9d21fe5"} Jun 09 14:41:30.884389 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:30.884303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" event={"ID":"06063208-30c8-41fb-9058-97ae11515552","Type":"ContainerStarted","Data":"7c3ede6bad96c9d112f1a7327795f13f01e5454395c9bf21d9285b4fee54f823"} Jun 09 14:41:31.677912 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.677872 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:41:31.680986 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:31.680927 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93411b5b_4cfa_489e_8fa9_f8064a7cee6c.slice/crio-00191dcc93cfc7be06db25c3ad2bf11d60fe6331592971bcb9ad23e16a298198 WatchSource:0}: Error finding container 00191dcc93cfc7be06db25c3ad2bf11d60fe6331592971bcb9ad23e16a298198: Status 404 returned error can't find the container with id 00191dcc93cfc7be06db25c3ad2bf11d60fe6331592971bcb9ad23e16a298198 Jun 09 14:41:31.890076 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.890043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" event={"ID":"06063208-30c8-41fb-9058-97ae11515552","Type":"ContainerStarted","Data":"668964032decee99c95582b8a7196b22d3ffebd01e7a8022df5360128bc9435d"} Jun 09 14:41:31.892151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.892119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" event={"ID":"720aa010-43e2-41ea-858c-e68c72ed09d0","Type":"ContainerStarted","Data":"c887b81c3610c9e3f93e09f44153d252436d8084f5c37678aaeea50b906181e7"} Jun 09 14:41:31.892281 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.892175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" event={"ID":"720aa010-43e2-41ea-858c-e68c72ed09d0","Type":"ContainerStarted","Data":"c8cfdc8fc41a328039c2ab14d7510acd0cdb927dbd73ecde46059ae98d98014f"} Jun 09 14:41:31.892281 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.892205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" event={"ID":"720aa010-43e2-41ea-858c-e68c72ed09d0","Type":"ContainerStarted","Data":"71f4245140f146c1e5383f0b7c94478114e14ed7376bb2c281a73b3c7a3382eb"} Jun 09 14:41:31.893243 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.893213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"00191dcc93cfc7be06db25c3ad2bf11d60fe6331592971bcb9ad23e16a298198"} Jun 09 14:41:31.899612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.899582 2564 generic.go:356] "Generic (PLEG): container finished" podID="d02fa7f5-1f00-44c4-aa84-cc1028c470f2" containerID="8a753bffd82aeacf7a2a27b92f333c5bf6fcf07b1a02a2e16131453419eed5bc" exitCode=0 Jun 09 14:41:31.899761 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.899624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js2xt" event={"ID":"d02fa7f5-1f00-44c4-aa84-cc1028c470f2","Type":"ContainerDied","Data":"8a753bffd82aeacf7a2a27b92f333c5bf6fcf07b1a02a2e16131453419eed5bc"} Jun 09 14:41:31.933568 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.933419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sz5pl" podStartSLOduration=1.414570856 podStartE2EDuration="2.933396903s" totalImagesPullingTime="1.518826047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:31.914429409 +0000 UTC m=+273.397704139" watchObservedRunningTime="2026-06-09 14:41:31.933396903 +0000 UTC m=+273.416671643" Jun 09 14:41:31.950353 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:31.950299 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-vjt2f" podStartSLOduration=1.33778618 podStartE2EDuration="2.950279202s" totalImagesPullingTime="1.612493022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:31.949775866 +0000 UTC m=+273.433050605" watchObservedRunningTime="2026-06-09 14:41:31.950279202 +0000 UTC m=+273.433553941" Jun 09 14:41:32.904568 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:32.904532 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b" exitCode=0 Jun 09 14:41:32.905022 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:32.904626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b"} Jun 09 14:41:32.906968 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:32.906941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js2xt" event={"ID":"d02fa7f5-1f00-44c4-aa84-cc1028c470f2","Type":"ContainerStarted","Data":"c559f060efabb399606ff93fa4bc78ed132a5a3fafb9096abc09d241b9eac736"} Jun 09 14:41:32.907107 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:32.906993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-js2xt" event={"ID":"d02fa7f5-1f00-44c4-aa84-cc1028c470f2","Type":"ContainerStarted","Data":"d3631160da77ee495100393197dd7118b37b4fc7b60c03219c5fb65787e957db"} Jun 09 14:41:32.950118 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:32.950052 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-js2xt" podStartSLOduration=2.144095727 podStartE2EDuration="3.950035492s" totalImagesPullingTime="1.708225523s" totalInitContainerRuntime="97.714242ms" isStatefulPod=true podCreationTimestamp="2026-06-09 14:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:32.94956554 +0000 UTC m=+274.432840279" watchObservedRunningTime="2026-06-09 14:41:32.950035492 +0000 UTC m=+274.433310230" Jun 09 14:41:33.882419 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.882387 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7745b9f7-554s5"] Jun 09 14:41:33.884838 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.884816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:33.888300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888072 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9m78pe1ougsm6\"" Jun 09 14:41:33.888300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888161 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 14:41:33.888300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888192 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 14:41:33.888300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qkqr8\"" Jun 09 14:41:33.888300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888294 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 14:41:33.888626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.888487 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 14:41:33.896201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:33.896176 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7745b9f7-554s5"] Jun 09 14:41:34.036274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-tls\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.036274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-client-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.036788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-metrics-server-audit-profiles\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.036859 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdf7\" (UniqueName: \"kubernetes.io/projected/b22fbccf-8456-4d53-b242-df45a8b454d2-kube-api-access-srdf7\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.036897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b22fbccf-8456-4d53-b242-df45a8b454d2-audit-log\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.036933 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-client-certs\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.037013 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.036991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.037467 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.037450 2564 scope.go:117] "RemoveContainer" containerID="102c684fe651b019eeb4417603ef8b553a0ca4d52f1ca9e3d070f592ad6e6d02" Jun 09 14:41:34.138352 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdf7\" (UniqueName: \"kubernetes.io/projected/b22fbccf-8456-4d53-b242-df45a8b454d2-kube-api-access-srdf7\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138352 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b22fbccf-8456-4d53-b242-df45a8b454d2-audit-log\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138352 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-client-certs\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-tls\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-client-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.138595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.138532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-metrics-server-audit-profiles\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.140571 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.140542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b22fbccf-8456-4d53-b242-df45a8b454d2-audit-log\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.143172 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.143144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-metrics-server-audit-profiles\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.143315 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.143305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22fbccf-8456-4d53-b242-df45a8b454d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.144593 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.144560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-client-certs\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.145392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.145348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-secret-metrics-server-tls\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.145738 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.145713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b22fbccf-8456-4d53-b242-df45a8b454d2-client-ca-bundle\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.156927 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.156899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdf7\" (UniqueName: \"kubernetes.io/projected/b22fbccf-8456-4d53-b242-df45a8b454d2-kube-api-access-srdf7\") pod \"metrics-server-7d7745b9f7-554s5\" (UID: \"b22fbccf-8456-4d53-b242-df45a8b454d2\") " pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.197903 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.197869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:34.382140 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.381980 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7745b9f7-554s5"] Jun 09 14:41:34.383986 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:34.383955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22fbccf_8456_4d53_b242_df45a8b454d2.slice/crio-e68b6b5c19ee83c4e5e923677659aef1f4824a906035f8368c169522699360b0 WatchSource:0}: Error finding container e68b6b5c19ee83c4e5e923677659aef1f4824a906035f8368c169522699360b0: Status 404 returned error can't find the container with id e68b6b5c19ee83c4e5e923677659aef1f4824a906035f8368c169522699360b0 Jun 09 14:41:34.922975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.922685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411"} Jun 09 14:41:34.922975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.922806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39"} Jun 09 14:41:34.922975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.922844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a"} Jun 09 14:41:34.922975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.922878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba"} Jun 09 14:41:34.922975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.922915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3"} Jun 09 14:41:34.925928 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.925904 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:41:34.926032 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.926001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" event={"ID":"b2db5a4b-aca6-49b2-82d9-a51ed82657e0","Type":"ContainerStarted","Data":"78a630395b4b53ac698fa9f27c1ec361f680bb4a2cbeba27098770df8813629c"} Jun 09 14:41:34.926429 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.926386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:41:34.927400 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.927380 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" event={"ID":"b22fbccf-8456-4d53-b242-df45a8b454d2","Type":"ContainerStarted","Data":"e68b6b5c19ee83c4e5e923677659aef1f4824a906035f8368c169522699360b0"} Jun 09 14:41:34.943471 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:34.943418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" podStartSLOduration=43.950422728 podStartE2EDuration="46.943402105s" totalImagesPullingTime="2.992979377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:34.942162667 +0000 UTC m=+276.425437406" watchObservedRunningTime="2026-06-09 14:41:34.943402105 +0000 UTC m=+276.426676845" Jun 09 14:41:35.480746 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:35.480717 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-h59n4" Jun 09 14:41:35.935748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:35.935716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerStarted","Data":"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792"} Jun 09 14:41:35.969581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:35.969534 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.979946739 podStartE2EDuration="5.969518671s" totalImagesPullingTime="2.973385112s" totalInitContainerRuntime="16.18682ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:35.967391292 +0000 UTC m=+277.450666033" watchObservedRunningTime="2026-06-09 14:41:35.969518671 +0000 UTC m=+277.452793452" Jun 09 14:41:36.940456 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:36.940417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" event={"ID":"b22fbccf-8456-4d53-b242-df45a8b454d2","Type":"ContainerStarted","Data":"b66c10e4686966c7161b082f191537da3ab557880dc62f7a2093e530c6f27d21"} Jun 09 14:41:36.962487 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:36.962436 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" podStartSLOduration=2.436498342 podStartE2EDuration="3.962421615s" totalImagesPullingTime="1.525923273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:36.960621949 +0000 UTC m=+278.443896686" watchObservedRunningTime="2026-06-09 14:41:36.962421615 +0000 UTC m=+278.445696353" Jun 09 14:41:39.516550 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:41:39.516512 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" podUID="5256d114-df22-4eb1-866b-046302c3c940" Jun 09 14:41:39.951739 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:39.951708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:41:42.922270 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.922233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:41:42.922639 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.922282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:41:42.924778 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.924754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89bf9679-28fb-427f-84c0-4b38f59e6126-metrics-tls\") pod \"dns-default-26dn6\" (UID: \"89bf9679-28fb-427f-84c0-4b38f59e6126\") " pod="openshift-dns/dns-default-26dn6" Jun 09 14:41:42.924911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.924887 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"image-registry-546fcddb96-vzcgq\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:41:42.941248 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.941226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w2kzc\"" Jun 09 14:41:42.949437 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.949418 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26dn6" Jun 09 14:41:42.955136 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.955116 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xxjlx\"" Jun 09 14:41:42.962568 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:42.962549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:41:43.114194 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.114124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26dn6"] Jun 09 14:41:43.117166 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:43.117135 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89bf9679_28fb_427f_84c0_4b38f59e6126.slice/crio-72176f878bcbe2ca96c71d4ea6e1e761e7e8fd72d87cf3cf3a892d48899f0419 WatchSource:0}: Error finding container 72176f878bcbe2ca96c71d4ea6e1e761e7e8fd72d87cf3cf3a892d48899f0419: Status 404 returned error can't find the container with id 72176f878bcbe2ca96c71d4ea6e1e761e7e8fd72d87cf3cf3a892d48899f0419 Jun 09 14:41:43.143220 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.143199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:41:43.145791 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:43.145766 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5256d114_df22_4eb1_866b_046302c3c940.slice/crio-fcc1fe1e2623874ba8f40a4dad473ee85adb54295402f26fa4a49675a2420c04 WatchSource:0}: Error finding container fcc1fe1e2623874ba8f40a4dad473ee85adb54295402f26fa4a49675a2420c04: Status 404 returned error can't find the container with id fcc1fe1e2623874ba8f40a4dad473ee85adb54295402f26fa4a49675a2420c04 Jun 09 14:41:43.973805 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.973761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26dn6" event={"ID":"89bf9679-28fb-427f-84c0-4b38f59e6126","Type":"ContainerStarted","Data":"72176f878bcbe2ca96c71d4ea6e1e761e7e8fd72d87cf3cf3a892d48899f0419"} Jun 09 14:41:43.975488 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.975460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" event={"ID":"5256d114-df22-4eb1-866b-046302c3c940","Type":"ContainerStarted","Data":"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b"} Jun 09 14:41:43.975621 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.975504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" event={"ID":"5256d114-df22-4eb1-866b-046302c3c940","Type":"ContainerStarted","Data":"fcc1fe1e2623874ba8f40a4dad473ee85adb54295402f26fa4a49675a2420c04"} Jun 09 14:41:43.975621 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:43.975595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:41:44.002656 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:44.002606 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" podStartSLOduration=285.002589904 podStartE2EDuration="4m45.002589904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:44.000562493 +0000 UTC m=+285.483837272" watchObservedRunningTime="2026-06-09 14:41:44.002589904 +0000 UTC m=+285.485864642" Jun 09 14:41:44.982284 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:44.982196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26dn6" event={"ID":"89bf9679-28fb-427f-84c0-4b38f59e6126","Type":"ContainerStarted","Data":"9733904c6b70f40a87164749412c6d6f126873804e6925eb0c0cfe6d6ef27655"} Jun 09 14:41:44.982284 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:44.982259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26dn6" event={"ID":"89bf9679-28fb-427f-84c0-4b38f59e6126","Type":"ContainerStarted","Data":"46b0495db7a0cd604c200fe4eb17f8f6c8a4d1199bb27aebfc2a5ff2dcc5ac95"} Jun 09 14:41:45.001352 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:45.001286 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26dn6" podStartSLOduration=251.491706268 podStartE2EDuration="4m13.001263531s" totalImagesPullingTime="1.509557263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:45.000591684 +0000 UTC m=+286.483866443" watchObservedRunningTime="2026-06-09 14:41:45.001263531 +0000 UTC m=+286.484538299" Jun 09 14:41:45.986559 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:45.986526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26dn6" Jun 09 14:41:46.995234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:46.995202 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:41:46.997448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:46.997430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.000026 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000007 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 14:41:47.000974 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000938 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 14:41:47.000974 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 14:41:47.000974 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000942 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 14:41:47.001176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000982 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pfpj9\"" Jun 09 14:41:47.001176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 14:41:47.001176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 14:41:47.001176 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.000941 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 14:41:47.017704 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.017680 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:41:47.060274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.060274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.060493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.060493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.060493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.060493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.060414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8nd\" (UniqueName: \"kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162431 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162431 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.162662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.162529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8nd\" (UniqueName: \"kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.163362 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.163259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.163362 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.163328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.163601 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.163533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.165123 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.165077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.165246 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.165226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.184403 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.184369 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8nd\" (UniqueName: \"kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd\") pod \"console-7b57695cc4-685px\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.306625 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.306536 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:47.440591 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.440551 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:41:47.442842 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:47.442814 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7107920_0824_48c8_acdf_a76273eaf31b.slice/crio-2e8033b78db743a03795f435e8ad278e530a644d0d9e40ebce7b79f070808238 WatchSource:0}: Error finding container 2e8033b78db743a03795f435e8ad278e530a644d0d9e40ebce7b79f070808238: Status 404 returned error can't find the container with id 2e8033b78db743a03795f435e8ad278e530a644d0d9e40ebce7b79f070808238 Jun 09 14:41:47.997095 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:47.997055 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b57695cc4-685px" event={"ID":"d7107920-0824-48c8-acdf-a76273eaf31b","Type":"ContainerStarted","Data":"2e8033b78db743a03795f435e8ad278e530a644d0d9e40ebce7b79f070808238"} Jun 09 14:41:51.012895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:51.012862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b57695cc4-685px" event={"ID":"d7107920-0824-48c8-acdf-a76273eaf31b","Type":"ContainerStarted","Data":"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e"} Jun 09 14:41:51.034578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:51.034526 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b57695cc4-685px" podStartSLOduration=2.193353654 podStartE2EDuration="5.034511046s" totalImagesPullingTime="2.841157392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:51.032368571 +0000 UTC m=+292.515643310" watchObservedRunningTime="2026-06-09 14:41:51.034511046 +0000 UTC m=+292.517785784" Jun 09 14:41:54.198643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:54.198595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:54.199141 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:54.198667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:41:55.798329 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.798293 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:41:55.802683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.802659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.811308 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.811288 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 14:41:55.818840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.818811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:41:55.840512 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840633 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840633 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840633 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840734 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmrbx\" (UniqueName: \"kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840734 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.840734 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.840719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942202 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942369 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942369 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942369 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmrbx\" (UniqueName: \"kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942535 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942535 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.942535 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.942510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.943118 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.943071 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.943359 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.943282 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.943443 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.943417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.943493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.943452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.944872 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.944843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.944990 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.944927 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.951843 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.951823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmrbx\" (UniqueName: \"kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx\") pod \"console-6d857547df-2dvjg\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:55.993215 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:55.993188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26dn6" Jun 09 14:41:56.112287 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:56.112253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:41:56.244458 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:56.241447 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:41:56.246143 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:41:56.246111 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba83fa3_7dc1_425e_ac3d_2affa6fb842c.slice/crio-037c6f8d0bc0a51111eceaa5b733aa99f82dcca1157811e3e05c3c86b90463ca WatchSource:0}: Error finding container 037c6f8d0bc0a51111eceaa5b733aa99f82dcca1157811e3e05c3c86b90463ca: Status 404 returned error can't find the container with id 037c6f8d0bc0a51111eceaa5b733aa99f82dcca1157811e3e05c3c86b90463ca Jun 09 14:41:57.042988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.042950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d857547df-2dvjg" event={"ID":"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c","Type":"ContainerStarted","Data":"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509"} Jun 09 14:41:57.043410 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.043002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d857547df-2dvjg" event={"ID":"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c","Type":"ContainerStarted","Data":"037c6f8d0bc0a51111eceaa5b733aa99f82dcca1157811e3e05c3c86b90463ca"} Jun 09 14:41:57.060332 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.060279 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d857547df-2dvjg" podStartSLOduration=2.060265156 podStartE2EDuration="2.060265156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:57.059530413 +0000 UTC m=+298.542805151" watchObservedRunningTime="2026-06-09 14:41:57.060265156 +0000 UTC m=+298.543539894" Jun 09 14:41:57.307490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.307411 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:57.307632 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.307500 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:41:57.308969 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.308944 2564 patch_prober.go:28] interesting pod/console-7b57695cc4-685px container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 09 14:41:57.309080 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:57.308986 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b57695cc4-685px" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 09 14:41:58.978832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:58.978803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:41:58.979292 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:58.978884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:41:58.990222 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:41:58.990198 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 14:42:02.966516 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:02.966477 2564 patch_prober.go:28] interesting pod/image-registry-546fcddb96-vzcgq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 14:42:02.968214 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:02.966543 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" podUID="5256d114-df22-4eb1-866b-046302c3c940" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 14:42:04.987009 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:04.986980 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:42:06.113280 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:06.113246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:42:06.113673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:06.113309 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:42:06.118052 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:06.118028 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:42:06.573282 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:06.573202 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:42:07.082522 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:07.082492 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:42:07.138367 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:07.138340 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:42:14.111027 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:14.110991 2564 generic.go:356] "Generic (PLEG): container finished" podID="2dee6e07-33ad-4a5d-b643-654c0e20e9bd" containerID="7078ec7f3a0c2b184ab9cb367d9815a49e9f2fa12ad2c3f0acf0011a9aeb8d0e" exitCode=0 Jun 09 14:42:14.111415 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:14.111059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" event={"ID":"2dee6e07-33ad-4a5d-b643-654c0e20e9bd","Type":"ContainerDied","Data":"7078ec7f3a0c2b184ab9cb367d9815a49e9f2fa12ad2c3f0acf0011a9aeb8d0e"} Jun 09 14:42:14.111415 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:14.111393 2564 scope.go:117] "RemoveContainer" containerID="7078ec7f3a0c2b184ab9cb367d9815a49e9f2fa12ad2c3f0acf0011a9aeb8d0e" Jun 09 14:42:14.205357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:14.205330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:42:14.210376 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:14.210350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7745b9f7-554s5" Jun 09 14:42:15.116645 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:15.116612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kpsrs" event={"ID":"2dee6e07-33ad-4a5d-b643-654c0e20e9bd","Type":"ContainerStarted","Data":"23bf008f7ff77e847286c55f58c951828e52a2dcdd7b58c314b3591762970e76"} Jun 09 14:42:18.129066 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:18.129032 2564 generic.go:356] "Generic (PLEG): container finished" podID="83bcf2c9-5f45-4659-97d3-9aa3b30804cb" containerID="4fda7ac90e526175b9004593bfd0f4c4fcdb782195f522019ad74fcbbe31cd4d" exitCode=0 Jun 09 14:42:18.129452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:18.129114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dgkpj" event={"ID":"83bcf2c9-5f45-4659-97d3-9aa3b30804cb","Type":"ContainerDied","Data":"4fda7ac90e526175b9004593bfd0f4c4fcdb782195f522019ad74fcbbe31cd4d"} Jun 09 14:42:18.129500 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:18.129463 2564 scope.go:117] "RemoveContainer" containerID="4fda7ac90e526175b9004593bfd0f4c4fcdb782195f522019ad74fcbbe31cd4d" Jun 09 14:42:19.135874 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:19.135835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dgkpj" event={"ID":"83bcf2c9-5f45-4659-97d3-9aa3b30804cb","Type":"ContainerStarted","Data":"e4c51fe80f06c5d1bf7652f33c82cc44a249c84fae75588786512f48c88dfa6a"} Jun 09 14:42:31.594820 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.594571 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" podUID="5256d114-df22-4eb1-866b-046302c3c940" containerName="registry" containerID="cri-o://2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b" gracePeriod=30 Jun 09 14:42:31.876063 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.876039 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966352 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966412 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966443 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghtlx\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966474 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966512 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966553 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966608 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.966653 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates\") pod \"5256d114-df22-4eb1-866b-046302c3c940\" (UID: \"5256d114-df22-4eb1-866b-046302c3c940\") " Jun 09 14:42:31.968201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.967285 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:31.969306 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.969010 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:31.980731 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.980649 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:31.980731 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.980656 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:31.980900 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.980870 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:31.981677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.981650 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:31.982293 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.982273 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx" (OuterVolumeSpecName: "kube-api-access-ghtlx") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "kube-api-access-ghtlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:31.985000 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:31.984973 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5256d114-df22-4eb1-866b-046302c3c940" (UID: "5256d114-df22-4eb1-866b-046302c3c940"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:42:32.068188 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068148 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-registry-tls\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068188 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068191 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-registry-certificates\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068208 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-image-registry-private-configuration\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068227 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5256d114-df22-4eb1-866b-046302c3c940-trusted-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068244 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghtlx\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-kube-api-access-ghtlx\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068257 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5256d114-df22-4eb1-866b-046302c3c940-installation-pull-secrets\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068271 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5256d114-df22-4eb1-866b-046302c3c940-ca-trust-extracted\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.068436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.068285 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5256d114-df22-4eb1-866b-046302c3c940-bound-sa-token\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.159055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.158945 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b57695cc4-685px" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" containerName="console" containerID="cri-o://71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e" gracePeriod=15 Jun 09 14:42:32.192402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.192364 2564 generic.go:356] "Generic (PLEG): container finished" podID="5256d114-df22-4eb1-866b-046302c3c940" containerID="2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b" exitCode=0 Jun 09 14:42:32.192552 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.192426 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" Jun 09 14:42:32.192552 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.192449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" event={"ID":"5256d114-df22-4eb1-866b-046302c3c940","Type":"ContainerDied","Data":"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b"} Jun 09 14:42:32.192552 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.192508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-546fcddb96-vzcgq" event={"ID":"5256d114-df22-4eb1-866b-046302c3c940","Type":"ContainerDied","Data":"fcc1fe1e2623874ba8f40a4dad473ee85adb54295402f26fa4a49675a2420c04"} Jun 09 14:42:32.192552 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.192533 2564 scope.go:117] "RemoveContainer" containerID="2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b" Jun 09 14:42:32.226050 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.226000 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:42:32.230129 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.230067 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-546fcddb96-vzcgq"] Jun 09 14:42:32.271035 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.271010 2564 scope.go:117] "RemoveContainer" containerID="2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b" Jun 09 14:42:32.271510 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:32.271465 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b\": container with ID starting with 2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b not found: ID does not exist" containerID="2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b" Jun 09 14:42:32.271624 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.271509 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b"} err="failed to get container status \"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b\": rpc error: code = NotFound desc = could not find container \"2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b\": container with ID starting with 2e0bd3fe62ff9fef07cdfc920023d164f4c7aeeda1b2ec376c291ddf2fe2aa6b not found: ID does not exist" Jun 09 14:42:32.427245 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.427217 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:42:32.471871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.471838 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472041 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.471914 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472041 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.471971 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb8nd\" (UniqueName: \"kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472041 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472233 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472062 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472233 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472155 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config\") pod \"d7107920-0824-48c8-acdf-a76273eaf31b\" (UID: \"d7107920-0824-48c8-acdf-a76273eaf31b\") " Jun 09 14:42:32.472336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472239 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config" (OuterVolumeSpecName: "console-config") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:32.472392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472356 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:32.472482 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472455 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:32.472977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472775 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-oauth-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.472977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472800 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-console-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.472977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.472815 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7107920-0824-48c8-acdf-a76273eaf31b-service-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.474626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.474599 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:32.474626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.474618 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:32.474767 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.474703 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd" (OuterVolumeSpecName: "kube-api-access-bb8nd") pod "d7107920-0824-48c8-acdf-a76273eaf31b" (UID: "d7107920-0824-48c8-acdf-a76273eaf31b"). InnerVolumeSpecName "kube-api-access-bb8nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:32.573581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.573526 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.573581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.573573 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7107920-0824-48c8-acdf-a76273eaf31b-console-oauth-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:32.573581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:32.573588 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb8nd\" (UniqueName: \"kubernetes.io/projected/d7107920-0824-48c8-acdf-a76273eaf31b-kube-api-access-bb8nd\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:33.046296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.044060 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5256d114-df22-4eb1-866b-046302c3c940" path="/var/lib/kubelet/pods/5256d114-df22-4eb1-866b-046302c3c940/volumes" Jun 09 14:42:33.198448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.198408 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7107920-0824-48c8-acdf-a76273eaf31b" containerID="71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e" exitCode=0 Jun 09 14:42:33.198448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.198453 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b57695cc4-685px" Jun 09 14:42:33.198668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.198501 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b57695cc4-685px" event={"ID":"d7107920-0824-48c8-acdf-a76273eaf31b","Type":"ContainerDied","Data":"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e"} Jun 09 14:42:33.198668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.198550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b57695cc4-685px" event={"ID":"d7107920-0824-48c8-acdf-a76273eaf31b","Type":"ContainerDied","Data":"2e8033b78db743a03795f435e8ad278e530a644d0d9e40ebce7b79f070808238"} Jun 09 14:42:33.198668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.198578 2564 scope.go:117] "RemoveContainer" containerID="71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e" Jun 09 14:42:33.207238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.207220 2564 scope.go:117] "RemoveContainer" containerID="71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e" Jun 09 14:42:33.207529 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:33.207500 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e\": container with ID starting with 71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e not found: ID does not exist" containerID="71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e" Jun 09 14:42:33.207603 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.207533 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e"} err="failed to get container status \"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e\": rpc error: code = NotFound desc = could not find container \"71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e\": container with ID starting with 71c9511515aec0dfd60a5e1ec22758eb76c47143c82d4d39ee0657bebb96a19e not found: ID does not exist" Jun 09 14:42:33.215414 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.215391 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:42:33.225003 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:33.224976 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b57695cc4-685px"] Jun 09 14:42:35.042259 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:35.042228 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" path="/var/lib/kubelet/pods/d7107920-0824-48c8-acdf-a76273eaf31b/volumes" Jun 09 14:42:49.721707 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.721618 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:49.722112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.721917 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="alertmanager" containerID="cri-o://878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3" gracePeriod=120 Jun 09 14:42:49.722112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.721977 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-metric" containerID="cri-o://94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411" gracePeriod=120 Jun 09 14:42:49.722112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.722001 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-web" containerID="cri-o://b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a" gracePeriod=120 Jun 09 14:42:49.722112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.722011 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="config-reloader" containerID="cri-o://43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba" gracePeriod=120 Jun 09 14:42:49.722112 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.722107 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="prom-label-proxy" containerID="cri-o://0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792" gracePeriod=120 Jun 09 14:42:49.722345 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:49.722071 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy" containerID="cri-o://b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39" gracePeriod=120 Jun 09 14:42:50.275490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275456 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792" exitCode=0 Jun 09 14:42:50.275490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275481 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411" exitCode=0 Jun 09 14:42:50.275490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275488 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39" exitCode=0 Jun 09 14:42:50.275490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275493 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba" exitCode=0 Jun 09 14:42:50.275490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275499 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3" exitCode=0 Jun 09 14:42:50.275785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792"} Jun 09 14:42:50.275785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411"} Jun 09 14:42:50.275785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39"} Jun 09 14:42:50.275785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba"} Jun 09 14:42:50.275785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.275661 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3"} Jun 09 14:42:50.966416 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:50.966392 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.037704 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.037895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037713 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ltrf\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.037895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037746 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.037895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037774 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.037895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037837 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.037895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037873 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.038192 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037924 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.038192 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037946 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.038192 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.037978 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.038338 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038180 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:51.038411 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038385 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038615 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038667 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038708 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038770 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.038950 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\" (UID: \"93411b5b-4cfa-489e-8fa9-f8064a7cee6c\") " Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.039229 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.039251 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-metrics-client-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.039557 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.039267 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-alertmanager-main-db\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.041372 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.041329 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf" (OuterVolumeSpecName: "kube-api-access-6ltrf") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "kube-api-access-6ltrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:51.043595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043309 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.043595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043397 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.043595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043420 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume" (OuterVolumeSpecName: "config-volume") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.043595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043529 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.043938 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043891 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out" (OuterVolumeSpecName: "config-out") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:42:51.043938 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.043894 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:42:51.045295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.045269 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.049805 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.049777 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.056370 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.056347 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config" (OuterVolumeSpecName: "web-config") pod "93411b5b-4cfa-489e-8fa9-f8064a7cee6c" (UID: "93411b5b-4cfa-489e-8fa9-f8064a7cee6c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:42:51.139921 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139884 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-main-tls\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.139921 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139915 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-cluster-tls-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.139921 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139924 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-volume\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139934 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139943 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-web-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139951 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-config-out\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139958 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-tls-assets\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139966 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139974 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ltrf\" (UniqueName: \"kubernetes.io/projected/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-kube-api-access-6ltrf\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.140186 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.139982 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93411b5b-4cfa-489e-8fa9-f8064a7cee6c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:42:51.283237 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.283205 2564 generic.go:356] "Generic (PLEG): container finished" podID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerID="b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a" exitCode=0 Jun 09 14:42:51.283396 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.283282 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.283396 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.283297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a"} Jun 09 14:42:51.283396 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.283366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93411b5b-4cfa-489e-8fa9-f8064a7cee6c","Type":"ContainerDied","Data":"00191dcc93cfc7be06db25c3ad2bf11d60fe6331592971bcb9ad23e16a298198"} Jun 09 14:42:51.283496 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.283399 2564 scope.go:117] "RemoveContainer" containerID="0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792" Jun 09 14:42:51.291469 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.291452 2564 scope.go:117] "RemoveContainer" containerID="94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411" Jun 09 14:42:51.298401 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.298385 2564 scope.go:117] "RemoveContainer" containerID="b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39" Jun 09 14:42:51.305169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.305153 2564 scope.go:117] "RemoveContainer" containerID="b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a" Jun 09 14:42:51.311624 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.311605 2564 scope.go:117] "RemoveContainer" containerID="43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba" Jun 09 14:42:51.318855 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.318833 2564 scope.go:117] "RemoveContainer" containerID="878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3" Jun 09 14:42:51.320873 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.320848 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:51.325938 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.325915 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:51.328132 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.328113 2564 scope.go:117] "RemoveContainer" containerID="313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b" Jun 09 14:42:51.335774 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.335751 2564 scope.go:117] "RemoveContainer" containerID="0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792" Jun 09 14:42:51.336195 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.336077 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792\": container with ID starting with 0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792 not found: ID does not exist" containerID="0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792" Jun 09 14:42:51.336267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336206 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792"} err="failed to get container status \"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792\": rpc error: code = NotFound desc = could not find container \"0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792\": container with ID starting with 0c546f5bdb7789e971092b2249f579ed4991857867c6fb5b361b8696b06ff792 not found: ID does not exist" Jun 09 14:42:51.336267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336226 2564 scope.go:117] "RemoveContainer" containerID="94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411" Jun 09 14:42:51.336512 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.336498 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411\": container with ID starting with 94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411 not found: ID does not exist" containerID="94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411" Jun 09 14:42:51.336564 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336515 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411"} err="failed to get container status \"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411\": rpc error: code = NotFound desc = could not find container \"94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411\": container with ID starting with 94441dfa24d874e7d1f1ea40d071a25f8f9ce45527592ed275866c482ca54411 not found: ID does not exist" Jun 09 14:42:51.336564 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336528 2564 scope.go:117] "RemoveContainer" containerID="b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39" Jun 09 14:42:51.336763 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.336747 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39\": container with ID starting with b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39 not found: ID does not exist" containerID="b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39" Jun 09 14:42:51.336813 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336767 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39"} err="failed to get container status \"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39\": rpc error: code = NotFound desc = could not find container \"b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39\": container with ID starting with b6d4e2876a79fecea7895c3c4a62574ee221c20af9e812db1d781049139baa39 not found: ID does not exist" Jun 09 14:42:51.336813 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.336781 2564 scope.go:117] "RemoveContainer" containerID="b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a" Jun 09 14:42:51.337010 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.336991 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a\": container with ID starting with b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a not found: ID does not exist" containerID="b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a" Jun 09 14:42:51.337109 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337021 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a"} err="failed to get container status \"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a\": rpc error: code = NotFound desc = could not find container \"b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a\": container with ID starting with b8f13ec230ba1b9110ab2370c4259c8d1620140f68a3b725eea50fc5df2c356a not found: ID does not exist" Jun 09 14:42:51.337109 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337044 2564 scope.go:117] "RemoveContainer" containerID="43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba" Jun 09 14:42:51.337279 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.337258 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba\": container with ID starting with 43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba not found: ID does not exist" containerID="43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba" Jun 09 14:42:51.337325 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337286 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba"} err="failed to get container status \"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba\": rpc error: code = NotFound desc = could not find container \"43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba\": container with ID starting with 43722a02ff94bdaaa01892905ae4de8d9f86590c815ea1a7c1da8f69a73d1bba not found: ID does not exist" Jun 09 14:42:51.337325 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337302 2564 scope.go:117] "RemoveContainer" containerID="878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3" Jun 09 14:42:51.337471 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.337454 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3\": container with ID starting with 878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3 not found: ID does not exist" containerID="878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3" Jun 09 14:42:51.337526 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337479 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3"} err="failed to get container status \"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3\": rpc error: code = NotFound desc = could not find container \"878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3\": container with ID starting with 878d6bf68d79054869699bc0ba9a03bc58abcd6c0da429647ac6a5e150f9c9a3 not found: ID does not exist" Jun 09 14:42:51.337526 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337499 2564 scope.go:117] "RemoveContainer" containerID="313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b" Jun 09 14:42:51.337759 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:42:51.337745 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b\": container with ID starting with 313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b not found: ID does not exist" containerID="313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b" Jun 09 14:42:51.337798 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.337762 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b"} err="failed to get container status \"313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b\": rpc error: code = NotFound desc = could not find container \"313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b\": container with ID starting with 313449b114b768127c7b9251a99a653456fe6209a702a27158a3851acbfe8e2b not found: ID does not exist" Jun 09 14:42:51.361744 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.361710 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:51.362022 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362000 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="init-config-reloader" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362024 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="init-config-reloader" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362034 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362040 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362047 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" containerName="console" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362053 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" containerName="console" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362061 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="alertmanager" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362067 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="alertmanager" Jun 09 14:42:51.362073 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362075 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="config-reloader" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362080 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="config-reloader" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362108 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="prom-label-proxy" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362114 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="prom-label-proxy" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362121 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-web" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362127 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-web" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362134 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-metric" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362139 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-metric" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362145 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5256d114-df22-4eb1-866b-046302c3c940" containerName="registry" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362150 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5256d114-df22-4eb1-866b-046302c3c940" containerName="registry" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362201 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5256d114-df22-4eb1-866b-046302c3c940" containerName="registry" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362210 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7107920-0824-48c8-acdf-a76273eaf31b" containerName="console" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362217 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="config-reloader" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362222 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="prom-label-proxy" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362229 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-web" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362234 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="alertmanager" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362239 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy" Jun 09 14:42:51.362312 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.362245 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" containerName="kube-rbac-proxy-metric" Jun 09 14:42:51.368685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.367371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.370770 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.370722 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 14:42:51.370909 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.370793 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 14:42:51.370909 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.370834 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stjpp\"" Jun 09 14:42:51.370909 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.370871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 14:42:51.371115 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.370927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 14:42:51.372970 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.372953 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 14:42:51.373060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.372960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 14:42:51.373060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.373018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 14:42:51.373713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.373698 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 14:42:51.377259 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.377238 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 14:42:51.386135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.386111 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:51.442434 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-config-volume\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442434 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-config-out\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2vx\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-kube-api-access-bx2vx\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442662 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-web-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.442887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.442804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543699 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-config-volume\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-config-out\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.543911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.543881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544371 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2vx\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-kube-api-access-bx2vx\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544493 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.544695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.544518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-web-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.545243 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.545167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.546562 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.546534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f33ae7ac-7981-4424-8455-ebb378c8a936-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547047 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547008 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f33ae7ac-7981-4424-8455-ebb378c8a936-config-out\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547273 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547699 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-config-volume\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547828 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547828 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-web-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.547905 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.547882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.548269 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.548250 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.548311 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.548296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.548554 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.548536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f33ae7ac-7981-4424-8455-ebb378c8a936-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.555982 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.555931 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2vx\" (UniqueName: \"kubernetes.io/projected/f33ae7ac-7981-4424-8455-ebb378c8a936-kube-api-access-bx2vx\") pod \"alertmanager-main-0\" (UID: \"f33ae7ac-7981-4424-8455-ebb378c8a936\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.678349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.678315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:42:51.822228 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:51.822044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:42:51.825125 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:42:51.825069 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf33ae7ac_7981_4424_8455_ebb378c8a936.slice/crio-4e610b0978343ee054ac7373771c784abeb146a69526e83d0e3c9201e2227a81 WatchSource:0}: Error finding container 4e610b0978343ee054ac7373771c784abeb146a69526e83d0e3c9201e2227a81: Status 404 returned error can't find the container with id 4e610b0978343ee054ac7373771c784abeb146a69526e83d0e3c9201e2227a81 Jun 09 14:42:52.288549 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:52.288513 2564 generic.go:356] "Generic (PLEG): container finished" podID="f33ae7ac-7981-4424-8455-ebb378c8a936" containerID="9a6a0b76666e5ddc00e431683dff70707f7f50b9b8332aa7e2dbc33130e05d4c" exitCode=0 Jun 09 14:42:52.288993 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:52.288600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerDied","Data":"9a6a0b76666e5ddc00e431683dff70707f7f50b9b8332aa7e2dbc33130e05d4c"} Jun 09 14:42:52.288993 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:52.288687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"4e610b0978343ee054ac7373771c784abeb146a69526e83d0e3c9201e2227a81"} Jun 09 14:42:53.042617 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.042582 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93411b5b-4cfa-489e-8fa9-f8064a7cee6c" path="/var/lib/kubelet/pods/93411b5b-4cfa-489e-8fa9-f8064a7cee6c/volumes" Jun 09 14:42:53.297332 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"8fcd230c29aa3d9be33a22ff07445570b069263b89abbb36dccbbd38894ab173"} Jun 09 14:42:53.297748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"e9ab26e1ad7a8b585c369071e3c3c01ae5f5cb96591d61ce90d4f4c4808de5bd"} Jun 09 14:42:53.297748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"45afa8877a481f43c892888064663f8fe216bfd712719ebf9c26329f133b7469"} Jun 09 14:42:53.297748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"5b69d5cf6ac972659f488fefe54f62d735d2d3bdd18d452551d5335b1feaea7f"} Jun 09 14:42:53.297748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"a12ca19f934c959d0ff2dc1445373cca1ebb9ccb3e830e331764ff74e72e3a41"} Jun 09 14:42:53.297748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.297453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f33ae7ac-7981-4424-8455-ebb378c8a936","Type":"ContainerStarted","Data":"53600599f131f26ce8c94b1ba4a54ee3d4c0f2ee4b2e4f652ef407f2970d1768"} Jun 09 14:42:53.333329 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.333278 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.31748597 podStartE2EDuration="2.333261732s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.775762ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:42:53.333006346 +0000 UTC m=+354.816281096" watchObservedRunningTime="2026-06-09 14:42:53.333261732 +0000 UTC m=+354.816536469" Jun 09 14:42:53.780747 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.780712 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-64cffb84bd-hnrtg"] Jun 09 14:42:53.783361 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.783343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.786418 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.786389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 14:42:53.786418 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.786402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 14:42:53.786882 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.786864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2rhdg\"" Jun 09 14:42:53.786959 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.786932 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 14:42:53.787005 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.786993 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 14:42:53.787397 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.787383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 14:42:53.792833 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.792815 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 14:42:53.803171 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.803150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64cffb84bd-hnrtg"] Jun 09 14:42:53.864887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.864851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-serving-certs-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.864887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.864888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9ps\" (UniqueName: \"kubernetes.io/projected/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-kube-api-access-4w9ps\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.864915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.864945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.865026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-federate-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.865048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-metrics-client-ca\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.865074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.865127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.865127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965523 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-serving-certs-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965523 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9ps\" (UniqueName: \"kubernetes.io/projected/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-kube-api-access-4w9ps\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-federate-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-metrics-client-ca\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.965735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.965657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.966495 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.966457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-metrics-client-ca\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.966608 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.966580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-serving-certs-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.966767 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.966748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.968275 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.968247 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-telemeter-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.968365 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.968295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.968661 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.968640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-federate-client-tls\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.968730 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.968674 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:53.975203 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:53.975179 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9ps\" (UniqueName: \"kubernetes.io/projected/c6031114-cbf2-4b23-8cf6-5ea83f28afc2-kube-api-access-4w9ps\") pod \"telemeter-client-64cffb84bd-hnrtg\" (UID: \"c6031114-cbf2-4b23-8cf6-5ea83f28afc2\") " pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:54.093235 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:54.093133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" Jun 09 14:42:54.237626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:54.237564 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-64cffb84bd-hnrtg"] Jun 09 14:42:54.240129 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:42:54.240099 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6031114_cbf2_4b23_8cf6_5ea83f28afc2.slice/crio-0ee8bb5a1b48b49f5761167a09909c4a996ea2986c475e86ba10ba33330ed4a6 WatchSource:0}: Error finding container 0ee8bb5a1b48b49f5761167a09909c4a996ea2986c475e86ba10ba33330ed4a6: Status 404 returned error can't find the container with id 0ee8bb5a1b48b49f5761167a09909c4a996ea2986c475e86ba10ba33330ed4a6 Jun 09 14:42:54.242240 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:54.242221 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:42:54.303690 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:54.303647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" event={"ID":"c6031114-cbf2-4b23-8cf6-5ea83f28afc2","Type":"ContainerStarted","Data":"0ee8bb5a1b48b49f5761167a09909c4a996ea2986c475e86ba10ba33330ed4a6"} Jun 09 14:42:56.318200 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:56.318161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" event={"ID":"c6031114-cbf2-4b23-8cf6-5ea83f28afc2","Type":"ContainerStarted","Data":"d35f0ffe98e531000cca604e0f030b5cabdbd1a897da28ae328d27041f7e13c4"} Jun 09 14:42:56.318521 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:56.318223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" event={"ID":"c6031114-cbf2-4b23-8cf6-5ea83f28afc2","Type":"ContainerStarted","Data":"5aa443fd1a6fe2eda5ca7dc3f2ae336e16875acbdab04f86d3cfd432fbe5f7b3"} Jun 09 14:42:56.318521 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:56.318244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" event={"ID":"c6031114-cbf2-4b23-8cf6-5ea83f28afc2","Type":"ContainerStarted","Data":"341a221dedd07187196ef9fc279972f63ab0b0e477b9138263d6cb4563abec8f"} Jun 09 14:42:56.347131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:56.347064 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-64cffb84bd-hnrtg" podStartSLOduration=1.482624048 podStartE2EDuration="3.347047601s" totalImagesPullingTime="1.864423553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:42:56.343990661 +0000 UTC m=+357.827265400" watchObservedRunningTime="2026-06-09 14:42:56.347047601 +0000 UTC m=+357.830322338" Jun 09 14:42:57.050956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.050923 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:42:57.053530 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.053508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.069457 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.069425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:42:57.195227 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195382 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7nf\" (UniqueName: \"kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.195616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.195530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7nf\" (UniqueName: \"kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.296941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.296909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.297694 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.297663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.297808 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.297754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.297861 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.297816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.298000 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.297976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.299431 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.299398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.299561 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.299539 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.305235 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.305192 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7nf\" (UniqueName: \"kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf\") pod \"console-c6c486bb8-mc9n2\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.363488 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.363449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:42:57.534894 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:57.534869 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:42:57.536808 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:42:57.536778 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e69cd8_db1d_4e15_84dd_38606277e22f.slice/crio-685f86988c3f17ec6186a1f383179db3e8f24bd783c0dd7f693b94090271e204 WatchSource:0}: Error finding container 685f86988c3f17ec6186a1f383179db3e8f24bd783c0dd7f693b94090271e204: Status 404 returned error can't find the container with id 685f86988c3f17ec6186a1f383179db3e8f24bd783c0dd7f693b94090271e204 Jun 09 14:42:58.329872 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:58.329834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6c486bb8-mc9n2" event={"ID":"39e69cd8-db1d-4e15-84dd-38606277e22f","Type":"ContainerStarted","Data":"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036"} Jun 09 14:42:58.330054 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:58.329888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6c486bb8-mc9n2" event={"ID":"39e69cd8-db1d-4e15-84dd-38606277e22f","Type":"ContainerStarted","Data":"685f86988c3f17ec6186a1f383179db3e8f24bd783c0dd7f693b94090271e204"} Jun 09 14:42:58.349755 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:42:58.349697 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6c486bb8-mc9n2" podStartSLOduration=1.349681802 podStartE2EDuration="1.349681802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:42:58.348188948 +0000 UTC m=+359.831463684" watchObservedRunningTime="2026-06-09 14:42:58.349681802 +0000 UTC m=+359.832956541" Jun 09 14:43:07.364315 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:07.364277 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:43:07.364799 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:07.364342 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:43:07.369413 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:07.369389 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:43:07.373319 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:07.373297 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:43:07.468546 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:07.468506 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:43:32.491899 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.491862 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d857547df-2dvjg" podUID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" containerName="console" containerID="cri-o://b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509" gracePeriod=15 Jun 09 14:43:32.735706 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.735684 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:43:32.805719 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.805636 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.805719 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.805679 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.805896 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.805732 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.805934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.805904 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmrbx\" (UniqueName: \"kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.806009 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.805989 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.806069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806023 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.806156 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config\") pod \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\" (UID: \"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c\") " Jun 09 14:43:32.806156 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806112 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:43:32.806156 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806134 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config" (OuterVolumeSpecName: "console-config") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:43:32.806303 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806173 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:43:32.806449 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806417 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:43:32.806581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806493 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.806581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806511 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-trusted-ca-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.806581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806524 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-service-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.806581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.806532 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-oauth-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.808164 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.808141 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx" (OuterVolumeSpecName: "kube-api-access-jmrbx") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "kube-api-access-jmrbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:43:32.808318 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.808298 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:43:32.808415 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.808392 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" (UID: "4ba83fa3-7dc1-425e-ac3d-2affa6fb842c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:43:32.907160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.907110 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmrbx\" (UniqueName: \"kubernetes.io/projected/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-kube-api-access-jmrbx\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.907160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.907157 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:32.907160 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:32.907172 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c-console-oauth-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:43:33.478433 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.478398 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" containerID="b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509" exitCode=0 Jun 09 14:43:33.478602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.478456 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d857547df-2dvjg" Jun 09 14:43:33.478602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.478461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d857547df-2dvjg" event={"ID":"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c","Type":"ContainerDied","Data":"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509"} Jun 09 14:43:33.478602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.478501 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d857547df-2dvjg" event={"ID":"4ba83fa3-7dc1-425e-ac3d-2affa6fb842c","Type":"ContainerDied","Data":"037c6f8d0bc0a51111eceaa5b733aa99f82dcca1157811e3e05c3c86b90463ca"} Jun 09 14:43:33.478602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.478521 2564 scope.go:117] "RemoveContainer" containerID="b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509" Jun 09 14:43:33.487634 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.487617 2564 scope.go:117] "RemoveContainer" containerID="b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509" Jun 09 14:43:33.487918 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:43:33.487898 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509\": container with ID starting with b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509 not found: ID does not exist" containerID="b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509" Jun 09 14:43:33.487997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.487925 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509"} err="failed to get container status \"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509\": rpc error: code = NotFound desc = could not find container \"b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509\": container with ID starting with b12de0695c79a1fd1d180edb88a07844db57ed3d1ff5326d5d757dbd364d4509 not found: ID does not exist" Jun 09 14:43:33.499212 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.499187 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:43:33.509377 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:33.509343 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d857547df-2dvjg"] Jun 09 14:43:35.042787 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:43:35.042752 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" path="/var/lib/kubelet/pods/4ba83fa3-7dc1-425e-ac3d-2affa6fb842c/volumes" Jun 09 14:44:18.080374 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.080341 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:44:18.080936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.080752 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" containerName="console" Jun 09 14:44:18.080936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.080771 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" containerName="console" Jun 09 14:44:18.080936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.080883 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba83fa3-7dc1-425e-ac3d-2affa6fb842c" containerName="console" Jun 09 14:44:18.083612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.083595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.107550 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.107519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:44:18.181975 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.181935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.181982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzv8k\" (UniqueName: \"kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.182009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.182062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.182152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182298 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.182193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.182298 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.182212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282722 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzv8k\" (UniqueName: \"kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.282915 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.282869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.283571 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.283534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.283842 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.283588 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.283842 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.283657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.283956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.283927 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.285594 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.285558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.285693 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.285620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.291665 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.291644 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzv8k\" (UniqueName: \"kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k\") pod \"console-75869899f5-9vjhm\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.394679 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.394645 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:18.524381 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.524251 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:44:18.527059 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:44:18.527034 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57196f75_46a0_480a_9861_484e9955a872.slice/crio-84f03f2f07a5acd9090332978bcaf86db1365cdb14ae4d81534125e8f12c9777 WatchSource:0}: Error finding container 84f03f2f07a5acd9090332978bcaf86db1365cdb14ae4d81534125e8f12c9777: Status 404 returned error can't find the container with id 84f03f2f07a5acd9090332978bcaf86db1365cdb14ae4d81534125e8f12c9777 Jun 09 14:44:18.663558 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.663453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75869899f5-9vjhm" event={"ID":"57196f75-46a0-480a-9861-484e9955a872","Type":"ContainerStarted","Data":"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096"} Jun 09 14:44:18.663558 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.663522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75869899f5-9vjhm" event={"ID":"57196f75-46a0-480a-9861-484e9955a872","Type":"ContainerStarted","Data":"84f03f2f07a5acd9090332978bcaf86db1365cdb14ae4d81534125e8f12c9777"} Jun 09 14:44:18.685572 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:18.685517 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75869899f5-9vjhm" podStartSLOduration=0.685501633 podStartE2EDuration="685.501633ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:44:18.684441732 +0000 UTC m=+440.167716471" watchObservedRunningTime="2026-06-09 14:44:18.685501633 +0000 UTC m=+440.168776371" Jun 09 14:44:28.395260 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:28.395219 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:28.395714 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:28.395278 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:28.400159 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:28.400134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:28.709724 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:28.709641 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:44:28.766258 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:28.766224 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:44:53.795398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:53.795355 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c6c486bb8-mc9n2" podUID="39e69cd8-db1d-4e15-84dd-38606277e22f" containerName="console" containerID="cri-o://d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036" gracePeriod=15 Jun 09 14:44:54.042536 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.042512 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:44:54.194575 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194541 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194760 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194604 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194760 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194632 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194760 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194737 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.194929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194883 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7nf\" (UniqueName: \"kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf\") pod \"39e69cd8-db1d-4e15-84dd-38606277e22f\" (UID: \"39e69cd8-db1d-4e15-84dd-38606277e22f\") " Jun 09 14:44:54.195062 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.194995 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:44:54.195181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195029 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:44:54.195181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195134 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca" (OuterVolumeSpecName: "service-ca") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:44:54.195284 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195241 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config" (OuterVolumeSpecName: "console-config") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:44:54.195284 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195255 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-oauth-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.195284 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195275 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-trusted-ca-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.195403 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.195289 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-service-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.196918 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.196892 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:44:54.197109 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.197070 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:44:54.197181 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.197151 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf" (OuterVolumeSpecName: "kube-api-access-fv7nf") pod "39e69cd8-db1d-4e15-84dd-38606277e22f" (UID: "39e69cd8-db1d-4e15-84dd-38606277e22f"). InnerVolumeSpecName "kube-api-access-fv7nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:44:54.295831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.295798 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.295831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.295826 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39e69cd8-db1d-4e15-84dd-38606277e22f-console-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.295831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.295837 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39e69cd8-db1d-4e15-84dd-38606277e22f-console-oauth-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.296054 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.295846 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7nf\" (UniqueName: \"kubernetes.io/projected/39e69cd8-db1d-4e15-84dd-38606277e22f-kube-api-access-fv7nf\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:44:54.811344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.811305 2564 generic.go:356] "Generic (PLEG): container finished" podID="39e69cd8-db1d-4e15-84dd-38606277e22f" containerID="d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036" exitCode=0 Jun 09 14:44:54.811753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.811355 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6c486bb8-mc9n2" Jun 09 14:44:54.811753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.811360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6c486bb8-mc9n2" event={"ID":"39e69cd8-db1d-4e15-84dd-38606277e22f","Type":"ContainerDied","Data":"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036"} Jun 09 14:44:54.811753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.811411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6c486bb8-mc9n2" event={"ID":"39e69cd8-db1d-4e15-84dd-38606277e22f","Type":"ContainerDied","Data":"685f86988c3f17ec6186a1f383179db3e8f24bd783c0dd7f693b94090271e204"} Jun 09 14:44:54.811753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.811438 2564 scope.go:117] "RemoveContainer" containerID="d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036" Jun 09 14:44:54.820417 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.820398 2564 scope.go:117] "RemoveContainer" containerID="d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036" Jun 09 14:44:54.820688 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:44:54.820670 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036\": container with ID starting with d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036 not found: ID does not exist" containerID="d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036" Jun 09 14:44:54.820735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.820697 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036"} err="failed to get container status \"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036\": rpc error: code = NotFound desc = could not find container \"d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036\": container with ID starting with d0aa8677975e39cf352c4f172fc3a10d66e6a0df7678dff534b9a2d691d82036 not found: ID does not exist" Jun 09 14:44:54.833361 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.833334 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:44:54.839471 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:54.839451 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6c486bb8-mc9n2"] Jun 09 14:44:55.043032 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:44:55.042998 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e69cd8-db1d-4e15-84dd-38606277e22f" path="/var/lib/kubelet/pods/39e69cd8-db1d-4e15-84dd-38606277e22f/volumes" Jun 09 14:45:56.668373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.668293 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx"] Jun 09 14:45:56.668850 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.668653 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e69cd8-db1d-4e15-84dd-38606277e22f" containerName="console" Jun 09 14:45:56.668850 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.668668 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e69cd8-db1d-4e15-84dd-38606277e22f" containerName="console" Jun 09 14:45:56.668850 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.668727 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e69cd8-db1d-4e15-84dd-38606277e22f" containerName="console" Jun 09 14:45:56.671831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.671810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.674481 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.674458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:45:56.674769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.674755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:45:56.675349 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.675336 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:45:56.685031 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.685008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx"] Jun 09 14:45:56.740539 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.740509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.740539 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.740545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwzv\" (UniqueName: \"kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.740751 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.740624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.841982 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.841928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.841982 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.841995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.842225 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.842017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwzv\" (UniqueName: \"kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.842365 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.842346 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.842402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.842374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.850977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.850945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwzv\" (UniqueName: \"kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:56.981366 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:56.981271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:45:57.121436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:57.121408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx"] Jun 09 14:45:57.123461 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:45:57.123435 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76027b1a_0c3b_4e06_a356_34a231e4cc09.slice/crio-b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed WatchSource:0}: Error finding container b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed: Status 404 returned error can't find the container with id b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed Jun 09 14:45:58.063601 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:45:58.063564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerStarted","Data":"b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed"} Jun 09 14:46:05.095924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:05.095892 2564 generic.go:356] "Generic (PLEG): container finished" podID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerID="3194d1e98bf020059687d7aa5c0b34a212dd44457ddad2cb6ca469c942bfed36" exitCode=0 Jun 09 14:46:05.096380 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:05.095954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerDied","Data":"3194d1e98bf020059687d7aa5c0b34a212dd44457ddad2cb6ca469c942bfed36"} Jun 09 14:46:07.107698 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:07.107673 2564 generic.go:356] "Generic (PLEG): container finished" podID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerID="c590b2ba1a8de097c57cbcac440f664aceaec6a83b1c29ccc94e1671f884cf34" exitCode=0 Jun 09 14:46:07.107997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:07.107758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerDied","Data":"c590b2ba1a8de097c57cbcac440f664aceaec6a83b1c29ccc94e1671f884cf34"} Jun 09 14:46:15.147234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:15.147200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerStarted","Data":"7056e32f2f11d4acbfcfafaa29870659c0cd8e37d7bf81b6454d58e2289bff6f"} Jun 09 14:46:15.165657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:15.165616 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" podStartSLOduration=1.525457416 podStartE2EDuration="19.16560018s" totalImagesPullingTime="17.640142764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:45:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:46:15.163974299 +0000 UTC m=+556.647249040" watchObservedRunningTime="2026-06-09 14:46:15.16560018 +0000 UTC m=+556.648874917" Jun 09 14:46:16.153858 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:16.153823 2564 generic.go:356] "Generic (PLEG): container finished" podID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerID="7056e32f2f11d4acbfcfafaa29870659c0cd8e37d7bf81b6454d58e2289bff6f" exitCode=0 Jun 09 14:46:16.154276 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:16.153909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerDied","Data":"7056e32f2f11d4acbfcfafaa29870659c0cd8e37d7bf81b6454d58e2289bff6f"} Jun 09 14:46:17.289597 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.289572 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:46:17.438949 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.438862 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwwzv\" (UniqueName: \"kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv\") pod \"76027b1a-0c3b-4e06-a356-34a231e4cc09\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " Jun 09 14:46:17.438949 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.438928 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util\") pod \"76027b1a-0c3b-4e06-a356-34a231e4cc09\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " Jun 09 14:46:17.439211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.438972 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle\") pod \"76027b1a-0c3b-4e06-a356-34a231e4cc09\" (UID: \"76027b1a-0c3b-4e06-a356-34a231e4cc09\") " Jun 09 14:46:17.439621 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.439600 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle" (OuterVolumeSpecName: "bundle") pod "76027b1a-0c3b-4e06-a356-34a231e4cc09" (UID: "76027b1a-0c3b-4e06-a356-34a231e4cc09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:17.441538 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.441508 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv" (OuterVolumeSpecName: "kube-api-access-cwwzv") pod "76027b1a-0c3b-4e06-a356-34a231e4cc09" (UID: "76027b1a-0c3b-4e06-a356-34a231e4cc09"). InnerVolumeSpecName "kube-api-access-cwwzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:46:17.443359 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.443336 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util" (OuterVolumeSpecName: "util") pod "76027b1a-0c3b-4e06-a356-34a231e4cc09" (UID: "76027b1a-0c3b-4e06-a356-34a231e4cc09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:17.540136 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.540096 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwwzv\" (UniqueName: \"kubernetes.io/projected/76027b1a-0c3b-4e06-a356-34a231e4cc09-kube-api-access-cwwzv\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:17.540136 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.540130 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:17.540302 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:17.540144 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76027b1a-0c3b-4e06-a356-34a231e4cc09-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:18.163747 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:18.163720 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" Jun 09 14:46:18.163929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:18.163746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlklvx" event={"ID":"76027b1a-0c3b-4e06-a356-34a231e4cc09","Type":"ContainerDied","Data":"b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed"} Jun 09 14:46:18.163929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:18.163799 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b977f15f39c6098d608e1f25829f68efedfefb6a1a7e103e953cd6fcfca0f3ed" Jun 09 14:46:24.788710 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.788673 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp"] Jun 09 14:46:24.789204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789155 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="extract" Jun 09 14:46:24.789204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789169 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="extract" Jun 09 14:46:24.789204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789187 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="pull" Jun 09 14:46:24.789204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789199 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="pull" Jun 09 14:46:24.789423 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789211 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="util" Jun 09 14:46:24.789423 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789216 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="util" Jun 09 14:46:24.789423 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.789279 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76027b1a-0c3b-4e06-a356-34a231e4cc09" containerName="extract" Jun 09 14:46:24.792550 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.792532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:24.795974 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.795947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ztvwq\"" Jun 09 14:46:24.796118 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.795948 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:46:24.796259 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.796242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 14:46:24.817385 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.817358 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp"] Jun 09 14:46:24.900925 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.900886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:24.901146 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:24.900962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cdzj\" (UniqueName: \"kubernetes.io/projected/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-kube-api-access-5cdzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.001837 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.001803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cdzj\" (UniqueName: \"kubernetes.io/projected/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-kube-api-access-5cdzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.002024 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.001862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.002277 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.002260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.015926 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.015903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cdzj\" (UniqueName: \"kubernetes.io/projected/0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d-kube-api-access-5cdzj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-4dxkp\" (UID: \"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.101480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.101450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" Jun 09 14:46:25.256666 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:25.256526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp"] Jun 09 14:46:25.259262 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:46:25.259235 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b36b82c_dc1f_4b79_9cf5_9bffbbfc1c0d.slice/crio-4c4fc187a1723212842ba6ea99777675482a0b8ce81408915a3b45b9ef183ccd WatchSource:0}: Error finding container 4c4fc187a1723212842ba6ea99777675482a0b8ce81408915a3b45b9ef183ccd: Status 404 returned error can't find the container with id 4c4fc187a1723212842ba6ea99777675482a0b8ce81408915a3b45b9ef183ccd Jun 09 14:46:26.201066 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:26.201033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" event={"ID":"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d","Type":"ContainerStarted","Data":"4c4fc187a1723212842ba6ea99777675482a0b8ce81408915a3b45b9ef183ccd"} Jun 09 14:46:27.208916 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:27.208887 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" event={"ID":"0b36b82c-dc1f-4b79-9cf5-9bffbbfc1c0d","Type":"ContainerStarted","Data":"bfdbbe3deb78f528a6450f1fcb26e08d03e36b4be2fd6ed638067964f3b43c6a"} Jun 09 14:46:27.232578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:27.232521 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-4dxkp" podStartSLOduration=1.384127692 podStartE2EDuration="3.232500469s" totalImagesPullingTime="1.848372777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:46:27.231023143 +0000 UTC m=+568.714297882" watchObservedRunningTime="2026-06-09 14:46:27.232500469 +0000 UTC m=+568.715775207" Jun 09 14:46:28.548696 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.548656 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk"] Jun 09 14:46:28.551366 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.551342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.554079 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.554029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:46:28.554212 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.554111 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:46:28.554977 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.554960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:46:28.565803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.565778 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk"] Jun 09 14:46:28.636920 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.636887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.636920 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.636919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ww98\" (UniqueName: \"kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.637128 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.636950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.737531 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.737497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.737718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.737543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ww98\" (UniqueName: \"kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.737718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.737592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.737895 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.737873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.737962 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.737918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.749816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.749795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ww98\" (UniqueName: \"kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.860550 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.860509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:28.995670 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:28.995649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk"] Jun 09 14:46:28.997928 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:46:28.997902 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69145a84_c25e_4fb3_be49_181d907e7473.slice/crio-decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d WatchSource:0}: Error finding container decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d: Status 404 returned error can't find the container with id decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d Jun 09 14:46:29.218762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.218685 2564 generic.go:356] "Generic (PLEG): container finished" podID="69145a84-c25e-4fb3-be49-181d907e7473" containerID="1a904de26788bfe2aef786ba59b0af3a171b86310cb21ba73a23ac665ef6ce39" exitCode=0 Jun 09 14:46:29.218906 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.218772 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" event={"ID":"69145a84-c25e-4fb3-be49-181d907e7473","Type":"ContainerDied","Data":"1a904de26788bfe2aef786ba59b0af3a171b86310cb21ba73a23ac665ef6ce39"} Jun 09 14:46:29.218906 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.218815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" event={"ID":"69145a84-c25e-4fb3-be49-181d907e7473","Type":"ContainerStarted","Data":"decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d"} Jun 09 14:46:29.616453 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.616419 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5"] Jun 09 14:46:29.618857 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.618839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.621355 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.621334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hw6c9\"" Jun 09 14:46:29.621470 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.621384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 14:46:29.621470 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.621337 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 14:46:29.630024 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.630003 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5"] Jun 09 14:46:29.645051 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.645021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.645175 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.645072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5ftd\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-kube-api-access-v5ftd\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.746178 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.746142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5ftd\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-kube-api-access-v5ftd\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.746373 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.746256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.754788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.754752 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.754936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.754913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5ftd\" (UniqueName: \"kubernetes.io/projected/ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f-kube-api-access-v5ftd\") pod \"cert-manager-webhook-7dc76cbb94-hx2x5\" (UID: \"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:29.936846 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:29.936747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:30.066211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:30.066188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5"] Jun 09 14:46:30.068853 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:46:30.068825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad42a6ea_8ba3_425c_8d8a_bd2d9e67176f.slice/crio-921dc1424169b7f71ad437515d7f745dfac300bebeabfacbdc4163afa756687d WatchSource:0}: Error finding container 921dc1424169b7f71ad437515d7f745dfac300bebeabfacbdc4163afa756687d: Status 404 returned error can't find the container with id 921dc1424169b7f71ad437515d7f745dfac300bebeabfacbdc4163afa756687d Jun 09 14:46:30.225938 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:30.225855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" event={"ID":"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f","Type":"ContainerStarted","Data":"921dc1424169b7f71ad437515d7f745dfac300bebeabfacbdc4163afa756687d"} Jun 09 14:46:32.239297 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:32.239260 2564 generic.go:356] "Generic (PLEG): container finished" podID="69145a84-c25e-4fb3-be49-181d907e7473" containerID="b08f26a040b9a751c30e8f27581b502d089257e0708213c8d6c704c6cb9221b2" exitCode=0 Jun 09 14:46:32.239686 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:32.239342 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" event={"ID":"69145a84-c25e-4fb3-be49-181d907e7473","Type":"ContainerDied","Data":"b08f26a040b9a751c30e8f27581b502d089257e0708213c8d6c704c6cb9221b2"} Jun 09 14:46:33.248048 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:33.248004 2564 generic.go:356] "Generic (PLEG): container finished" podID="69145a84-c25e-4fb3-be49-181d907e7473" containerID="291dba973672ba62bde21f125528b14bef860e13656788f9993a12cf8d40af29" exitCode=0 Jun 09 14:46:33.248544 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:33.248136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" event={"ID":"69145a84-c25e-4fb3-be49-181d907e7473","Type":"ContainerDied","Data":"291dba973672ba62bde21f125528b14bef860e13656788f9993a12cf8d40af29"} Jun 09 14:46:34.254782 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.254745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" event={"ID":"ad42a6ea-8ba3-425c-8d8a-bd2d9e67176f","Type":"ContainerStarted","Data":"e875d784635d6188e87217f5aa3b10aa43cf2ab8383ef59185a1d9b3ec432101"} Jun 09 14:46:34.255231 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.254877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:34.271448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.271382 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" podStartSLOduration=1.739556489 podStartE2EDuration="5.271359317s" totalImagesPullingTime="3.531802828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:46:34.270622059 +0000 UTC m=+575.753896798" watchObservedRunningTime="2026-06-09 14:46:34.271359317 +0000 UTC m=+575.754634056" Jun 09 14:46:34.380973 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.380948 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:34.491143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.491112 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle\") pod \"69145a84-c25e-4fb3-be49-181d907e7473\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " Jun 09 14:46:34.491316 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.491174 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ww98\" (UniqueName: \"kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98\") pod \"69145a84-c25e-4fb3-be49-181d907e7473\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " Jun 09 14:46:34.491316 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.491237 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util\") pod \"69145a84-c25e-4fb3-be49-181d907e7473\" (UID: \"69145a84-c25e-4fb3-be49-181d907e7473\") " Jun 09 14:46:34.491569 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.491542 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle" (OuterVolumeSpecName: "bundle") pod "69145a84-c25e-4fb3-be49-181d907e7473" (UID: "69145a84-c25e-4fb3-be49-181d907e7473"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:34.493433 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.493407 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98" (OuterVolumeSpecName: "kube-api-access-8ww98") pod "69145a84-c25e-4fb3-be49-181d907e7473" (UID: "69145a84-c25e-4fb3-be49-181d907e7473"). InnerVolumeSpecName "kube-api-access-8ww98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:46:34.495733 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.495706 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util" (OuterVolumeSpecName: "util") pod "69145a84-c25e-4fb3-be49-181d907e7473" (UID: "69145a84-c25e-4fb3-be49-181d907e7473"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:34.592586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.592507 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ww98\" (UniqueName: \"kubernetes.io/projected/69145a84-c25e-4fb3-be49-181d907e7473-kube-api-access-8ww98\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:34.592586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.592536 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:34.592586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:34.592546 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69145a84-c25e-4fb3-be49-181d907e7473-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:35.261295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.261263 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" Jun 09 14:46:35.261295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.261285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frmtsk" event={"ID":"69145a84-c25e-4fb3-be49-181d907e7473","Type":"ContainerDied","Data":"decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d"} Jun 09 14:46:35.261768 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.261330 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="decaebe7196a250bf4903eb40d6b3cfcc3ec034cdb98387d37f49054eab8535d" Jun 09 14:46:35.684930 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.684892 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2phw4"] Jun 09 14:46:35.685249 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685236 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="pull" Jun 09 14:46:35.685296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685250 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="pull" Jun 09 14:46:35.685296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685259 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="extract" Jun 09 14:46:35.685296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685265 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="extract" Jun 09 14:46:35.685296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685283 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="util" Jun 09 14:46:35.685296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685290 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="util" Jun 09 14:46:35.685442 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.685346 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="69145a84-c25e-4fb3-be49-181d907e7473" containerName="extract" Jun 09 14:46:35.687442 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.687424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.690892 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.690867 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b7f99\"" Jun 09 14:46:35.699546 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.699525 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2phw4"] Jun 09 14:46:35.803536 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.803504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.803801 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.803556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4l9\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-kube-api-access-9l4l9\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.904844 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.904806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.904997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.904869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4l9\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-kube-api-access-9l4l9\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.913545 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.913512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.913735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.913712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4l9\" (UniqueName: \"kubernetes.io/projected/be9db5e1-6e50-4d30-9d89-6228ce6e18b0-kube-api-access-9l4l9\") pod \"cert-manager-cainjector-5d99449ffd-2phw4\" (UID: \"be9db5e1-6e50-4d30-9d89-6228ce6e18b0\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:35.996883 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:35.996799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" Jun 09 14:46:36.127946 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:36.127922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2phw4"] Jun 09 14:46:36.130440 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:46:36.130415 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe9db5e1_6e50_4d30_9d89_6228ce6e18b0.slice/crio-4d3bf3772b35a426b1da8cf95f7c3782d5a1bb4b69f77ddc0a17404363e3e92a WatchSource:0}: Error finding container 4d3bf3772b35a426b1da8cf95f7c3782d5a1bb4b69f77ddc0a17404363e3e92a: Status 404 returned error can't find the container with id 4d3bf3772b35a426b1da8cf95f7c3782d5a1bb4b69f77ddc0a17404363e3e92a Jun 09 14:46:36.267857 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:36.267765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" event={"ID":"be9db5e1-6e50-4d30-9d89-6228ce6e18b0","Type":"ContainerStarted","Data":"25ef7780c31a9b9c83ec3571005f5a0bb60bccc845f1ad6cd37041c42ae77904"} Jun 09 14:46:36.267857 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:36.267813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" event={"ID":"be9db5e1-6e50-4d30-9d89-6228ce6e18b0","Type":"ContainerStarted","Data":"4d3bf3772b35a426b1da8cf95f7c3782d5a1bb4b69f77ddc0a17404363e3e92a"} Jun 09 14:46:36.285803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:36.285751 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2phw4" podStartSLOduration=1.28572806 podStartE2EDuration="1.28572806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:46:36.283752244 +0000 UTC m=+577.767026982" watchObservedRunningTime="2026-06-09 14:46:36.28572806 +0000 UTC m=+577.769002799" Jun 09 14:46:40.263165 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:40.263135 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hx2x5" Jun 09 14:46:50.277816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.277773 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx"] Jun 09 14:46:50.296149 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.296108 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx"] Jun 09 14:46:50.296295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.296241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.299033 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.299011 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:46:50.299190 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.299035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:46:50.300136 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.300075 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:46:50.435476 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.435443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.435476 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.435480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.435691 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.435511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrvh\" (UniqueName: \"kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.536803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.536705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.536803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.536750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.536803 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.536776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrvh\" (UniqueName: \"kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.537175 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.537151 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.537255 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.537203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.545585 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.545564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrvh\" (UniqueName: \"kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.605837 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.605806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:50.738964 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:50.738942 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx"] Jun 09 14:46:50.740754 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:46:50.740721 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5747b9f3_33ad_4939_9eab_05b50e92794b.slice/crio-9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c WatchSource:0}: Error finding container 9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c: Status 404 returned error can't find the container with id 9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c Jun 09 14:46:51.338236 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:51.338200 2564 generic.go:356] "Generic (PLEG): container finished" podID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerID="eacc9c709409cf33e94c9d1e931bc23d93546a6f72788e362f17625956533640" exitCode=0 Jun 09 14:46:51.338633 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:51.338293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" event={"ID":"5747b9f3-33ad-4939-9eab-05b50e92794b","Type":"ContainerDied","Data":"eacc9c709409cf33e94c9d1e931bc23d93546a6f72788e362f17625956533640"} Jun 09 14:46:51.338633 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:51.338346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" event={"ID":"5747b9f3-33ad-4939-9eab-05b50e92794b","Type":"ContainerStarted","Data":"9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c"} Jun 09 14:46:52.345779 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:52.345687 2564 generic.go:356] "Generic (PLEG): container finished" podID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerID="428bc4f534e22dfa9e6ab300173bce42efb8e3838ad338e6bb349ac29eee0ad3" exitCode=0 Jun 09 14:46:52.346249 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:52.345776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" event={"ID":"5747b9f3-33ad-4939-9eab-05b50e92794b","Type":"ContainerDied","Data":"428bc4f534e22dfa9e6ab300173bce42efb8e3838ad338e6bb349ac29eee0ad3"} Jun 09 14:46:53.358266 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:53.358224 2564 generic.go:356] "Generic (PLEG): container finished" podID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerID="5329a38ec2f2d310db00198c7f0e1a3af16f94e4617ba0a52ea3d828ba2c44f2" exitCode=0 Jun 09 14:46:53.358652 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:53.358299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" event={"ID":"5747b9f3-33ad-4939-9eab-05b50e92794b","Type":"ContainerDied","Data":"5329a38ec2f2d310db00198c7f0e1a3af16f94e4617ba0a52ea3d828ba2c44f2"} Jun 09 14:46:54.492011 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.491987 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:54.573583 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.573550 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrvh\" (UniqueName: \"kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh\") pod \"5747b9f3-33ad-4939-9eab-05b50e92794b\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " Jun 09 14:46:54.573766 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.573605 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util\") pod \"5747b9f3-33ad-4939-9eab-05b50e92794b\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " Jun 09 14:46:54.573843 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.573778 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle\") pod \"5747b9f3-33ad-4939-9eab-05b50e92794b\" (UID: \"5747b9f3-33ad-4939-9eab-05b50e92794b\") " Jun 09 14:46:54.574459 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.574436 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle" (OuterVolumeSpecName: "bundle") pod "5747b9f3-33ad-4939-9eab-05b50e92794b" (UID: "5747b9f3-33ad-4939-9eab-05b50e92794b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:54.575828 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.575802 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh" (OuterVolumeSpecName: "kube-api-access-hrrvh") pod "5747b9f3-33ad-4939-9eab-05b50e92794b" (UID: "5747b9f3-33ad-4939-9eab-05b50e92794b"). InnerVolumeSpecName "kube-api-access-hrrvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:46:54.579208 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.579173 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util" (OuterVolumeSpecName: "util") pod "5747b9f3-33ad-4939-9eab-05b50e92794b" (UID: "5747b9f3-33ad-4939-9eab-05b50e92794b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:46:54.675135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.675013 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrvh\" (UniqueName: \"kubernetes.io/projected/5747b9f3-33ad-4939-9eab-05b50e92794b-kube-api-access-hrrvh\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:54.675135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.675057 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:54.675135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:54.675067 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5747b9f3-33ad-4939-9eab-05b50e92794b-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:46:55.368762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:55.368740 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" Jun 09 14:46:55.368762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:55.368756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd25mcx" event={"ID":"5747b9f3-33ad-4939-9eab-05b50e92794b","Type":"ContainerDied","Data":"9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c"} Jun 09 14:46:55.368958 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:55.368799 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f3ec7fafd4ff7727e3956f9d0705490ddccaa1e9c92fa7463d8e92ffd819e0c" Jun 09 14:46:59.014956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:59.014928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:46:59.015879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:46:59.015857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:47:02.917211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917183 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd"] Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917517 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="util" Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917528 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="util" Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917537 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="pull" Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917542 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="pull" Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917556 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="extract" Jun 09 14:47:02.917578 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917562 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="extract" Jun 09 14:47:02.917761 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.917617 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5747b9f3-33ad-4939-9eab-05b50e92794b" containerName="extract" Jun 09 14:47:02.920870 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.920851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:02.927781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.927758 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 14:47:02.927879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.927858 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 14:47:02.928196 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.928179 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 14:47:02.928816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.928799 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sptz4\"" Jun 09 14:47:02.928905 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.928889 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 14:47:02.943806 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:02.943786 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd"] Jun 09 14:47:03.046861 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.046735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6gc7\" (UniqueName: \"kubernetes.io/projected/1540582a-1299-42e5-8ade-752931e3c8dc-kube-api-access-p6gc7\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.046861 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.046822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.046861 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.046856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.054187 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.046887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.054187 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.046913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.147708 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.147675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.147708 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.147712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.147956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.147737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.147956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.147756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.147956 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.147803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6gc7\" (UniqueName: \"kubernetes.io/projected/1540582a-1299-42e5-8ade-752931e3c8dc-kube-api-access-p6gc7\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.148169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.148142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.150435 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.150403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1540582a-1299-42e5-8ade-752931e3c8dc-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.150540 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.150475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.150594 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.150542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1540582a-1299-42e5-8ade-752931e3c8dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.160166 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.160143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6gc7\" (UniqueName: \"kubernetes.io/projected/1540582a-1299-42e5-8ade-752931e3c8dc-kube-api-access-p6gc7\") pod \"opendatahub-operator-controller-manager-5c95c9747d-zr7bd\" (UID: \"1540582a-1299-42e5-8ade-752931e3c8dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.231673 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.231588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:03.372962 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.372930 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd"] Jun 09 14:47:03.375385 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:47:03.375360 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1540582a_1299_42e5_8ade_752931e3c8dc.slice/crio-26b913ed86bbfb86b4d6bdae5d8442f7411fd908a5b8f584b0d58f0e4b28ff71 WatchSource:0}: Error finding container 26b913ed86bbfb86b4d6bdae5d8442f7411fd908a5b8f584b0d58f0e4b28ff71: Status 404 returned error can't find the container with id 26b913ed86bbfb86b4d6bdae5d8442f7411fd908a5b8f584b0d58f0e4b28ff71 Jun 09 14:47:03.414166 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:03.414126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" event={"ID":"1540582a-1299-42e5-8ade-752931e3c8dc","Type":"ContainerStarted","Data":"26b913ed86bbfb86b4d6bdae5d8442f7411fd908a5b8f584b0d58f0e4b28ff71"} Jun 09 14:47:06.433661 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:06.433576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" event={"ID":"1540582a-1299-42e5-8ade-752931e3c8dc","Type":"ContainerStarted","Data":"e4cd744c85ba73319577d15f56cad71a1f1671e891487b64e545999c437dc6e4"} Jun 09 14:47:07.439952 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:07.439913 2564 generic.go:356] "Generic (PLEG): container finished" podID="1540582a-1299-42e5-8ade-752931e3c8dc" containerID="e4cd744c85ba73319577d15f56cad71a1f1671e891487b64e545999c437dc6e4" exitCode=0 Jun 09 14:47:07.440375 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:07.439959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" event={"ID":"1540582a-1299-42e5-8ade-752931e3c8dc","Type":"ContainerDied","Data":"e4cd744c85ba73319577d15f56cad71a1f1671e891487b64e545999c437dc6e4"} Jun 09 14:47:08.447329 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:08.447296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" event={"ID":"1540582a-1299-42e5-8ade-752931e3c8dc","Type":"ContainerStarted","Data":"36297016f3d1779fa8e355fe2248715e328532e2b9a3e93ac5cb7293fdc398a1"} Jun 09 14:47:08.447715 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:08.447419 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:08.473409 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:08.473353 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" podStartSLOduration=2.367361371 podStartE2EDuration="6.47330672s" totalImagesPullingTime="3.080943124s" totalInitContainerRuntime="1.025002225s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:08.471238854 +0000 UTC m=+609.954513591" watchObservedRunningTime="2026-06-09 14:47:08.47330672 +0000 UTC m=+609.956581462" Jun 09 14:47:19.454166 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:19.454129 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-zr7bd" Jun 09 14:47:20.451113 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.451050 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg"] Jun 09 14:47:20.459046 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.459013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.461570 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.461548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 14:47:20.462717 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.462699 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 14:47:20.462824 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.462784 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 14:47:20.462824 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.462791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:47:20.462824 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.462811 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vk9kw\"" Jun 09 14:47:20.462964 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.462791 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 14:47:20.468796 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.468776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg"] Jun 09 14:47:20.508720 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.508684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8v8g\" (UniqueName: \"kubernetes.io/projected/46decef0-af09-4ea9-9509-9e3174daf082-kube-api-access-j8v8g\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.508942 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.508748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/46decef0-af09-4ea9-9509-9e3174daf082-manager-config\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.508942 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.508766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-metrics-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.508942 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.508836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.609748 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.609713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.609931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.609788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v8g\" (UniqueName: \"kubernetes.io/projected/46decef0-af09-4ea9-9509-9e3174daf082-kube-api-access-j8v8g\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.609931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.609821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/46decef0-af09-4ea9-9509-9e3174daf082-manager-config\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.609931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.609837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-metrics-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.610659 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.610597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/46decef0-af09-4ea9-9509-9e3174daf082-manager-config\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.612412 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.612390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.612502 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.612425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/46decef0-af09-4ea9-9509-9e3174daf082-metrics-cert\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.622162 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.622143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v8g\" (UniqueName: \"kubernetes.io/projected/46decef0-af09-4ea9-9509-9e3174daf082-kube-api-access-j8v8g\") pod \"lws-controller-manager-6fc4b59877-r6fbg\" (UID: \"46decef0-af09-4ea9-9509-9e3174daf082\") " pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.769938 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.769860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:20.914367 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:20.914339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg"] Jun 09 14:47:20.916849 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:47:20.916822 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46decef0_af09_4ea9_9509_9e3174daf082.slice/crio-944d3c1661fc61fa1aaae25dc42409c04dbd24a3911bfaf632e51006fa2add29 WatchSource:0}: Error finding container 944d3c1661fc61fa1aaae25dc42409c04dbd24a3911bfaf632e51006fa2add29: Status 404 returned error can't find the container with id 944d3c1661fc61fa1aaae25dc42409c04dbd24a3911bfaf632e51006fa2add29 Jun 09 14:47:21.519599 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:21.519553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" event={"ID":"46decef0-af09-4ea9-9509-9e3174daf082","Type":"ContainerStarted","Data":"944d3c1661fc61fa1aaae25dc42409c04dbd24a3911bfaf632e51006fa2add29"} Jun 09 14:47:22.943277 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.943201 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd"] Jun 09 14:47:22.947059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.947036 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:22.953197 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.953167 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 14:47:22.954214 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.954186 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 14:47:22.954351 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.954328 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-26z7q\"" Jun 09 14:47:22.955562 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.955541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 14:47:22.955678 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.955645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 14:47:22.972209 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:22.972182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd"] Jun 09 14:47:23.032398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.032365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psp8t\" (UniqueName: \"kubernetes.io/projected/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-kube-api-access-psp8t\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.032599 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.032502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.032599 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.032551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.097692 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.097662 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v"] Jun 09 14:47:23.101523 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.101500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.112225 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.112204 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:47:23.112811 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.112794 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:47:23.112871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.112842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:47:23.118858 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.118838 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v"] Jun 09 14:47:23.133147 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.133123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.133268 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.133181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psp8t\" (UniqueName: \"kubernetes.io/projected/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-kube-api-access-psp8t\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.133268 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.133246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.135467 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.135446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.135598 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.135581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.174390 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.174356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psp8t\" (UniqueName: \"kubernetes.io/projected/1806b7e0-5f5d-4c5b-bd73-fc87bf908be2-kube-api-access-psp8t\") pod \"kube-auth-proxy-7cc4cf49bf-m7wbd\" (UID: \"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.234318 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.234225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.234318 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.234279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.234532 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.234382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp5g\" (UniqueName: \"kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.258526 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.258503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" Jun 09 14:47:23.334877 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.334845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.335023 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.334900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp5g\" (UniqueName: \"kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.335023 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.334945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.335251 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.335232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.335330 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.335308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.348222 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.348195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp5g\" (UniqueName: \"kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.397671 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.397603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd"] Jun 09 14:47:23.399930 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:47:23.399902 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1806b7e0_5f5d_4c5b_bd73_fc87bf908be2.slice/crio-943fa0de144f27045809eb62344a68f2c6aefef129dc71f0fc9cfe193b97fe4f WatchSource:0}: Error finding container 943fa0de144f27045809eb62344a68f2c6aefef129dc71f0fc9cfe193b97fe4f: Status 404 returned error can't find the container with id 943fa0de144f27045809eb62344a68f2c6aefef129dc71f0fc9cfe193b97fe4f Jun 09 14:47:23.411405 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.411378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:23.534416 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.534379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" event={"ID":"46decef0-af09-4ea9-9509-9e3174daf082","Type":"ContainerStarted","Data":"2fa95843db5d1ff60a1c05984fc4a959e4009744c5d1919942986a8675a41e1f"} Jun 09 14:47:23.534629 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.534603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:23.536213 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.536189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" event={"ID":"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2","Type":"ContainerStarted","Data":"943fa0de144f27045809eb62344a68f2c6aefef129dc71f0fc9cfe193b97fe4f"} Jun 09 14:47:23.574526 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.574485 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" podStartSLOduration=1.8045731489999999 podStartE2EDuration="3.574471589s" totalImagesPullingTime="1.76989844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:23.572071173 +0000 UTC m=+625.055345912" watchObservedRunningTime="2026-06-09 14:47:23.574471589 +0000 UTC m=+625.057746326" Jun 09 14:47:23.576161 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:47:23.576140 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28fd7349_1e35_4173_be0a_8d81c515cdf4.slice/crio-d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681 WatchSource:0}: Error finding container d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681: Status 404 returned error can't find the container with id d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681 Jun 09 14:47:23.577430 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:23.577406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v"] Jun 09 14:47:24.546648 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:24.546547 2564 generic.go:356] "Generic (PLEG): container finished" podID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerID="2289194054d3f3daa795f85d627c60401a407591f7e5e7c38394d575a11bb3ad" exitCode=0 Jun 09 14:47:24.546648 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:24.546637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" event={"ID":"28fd7349-1e35-4173-be0a-8d81c515cdf4","Type":"ContainerDied","Data":"2289194054d3f3daa795f85d627c60401a407591f7e5e7c38394d575a11bb3ad"} Jun 09 14:47:24.547221 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:24.546681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" event={"ID":"28fd7349-1e35-4173-be0a-8d81c515cdf4","Type":"ContainerStarted","Data":"d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681"} Jun 09 14:47:26.563685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:26.563514 2564 generic.go:356] "Generic (PLEG): container finished" podID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerID="f507937ea7e4c7107d833460b4eb0975b63cc31d9f28e5930350e248f9db0949" exitCode=0 Jun 09 14:47:26.563685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:26.563603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" event={"ID":"28fd7349-1e35-4173-be0a-8d81c515cdf4","Type":"ContainerDied","Data":"f507937ea7e4c7107d833460b4eb0975b63cc31d9f28e5930350e248f9db0949"} Jun 09 14:47:27.570682 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:27.570650 2564 generic.go:356] "Generic (PLEG): container finished" podID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerID="30589454d7f5dcf0fb8bdd4e965d3f21662aae3867dff4b0cdb9ed0c495498b0" exitCode=0 Jun 09 14:47:27.571134 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:27.570735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" event={"ID":"28fd7349-1e35-4173-be0a-8d81c515cdf4","Type":"ContainerDied","Data":"30589454d7f5dcf0fb8bdd4e965d3f21662aae3867dff4b0cdb9ed0c495498b0"} Jun 09 14:47:27.572175 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:27.572158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" event={"ID":"1806b7e0-5f5d-4c5b-bd73-fc87bf908be2","Type":"ContainerStarted","Data":"e605ca96656dc0b72e13f266452dd708b41271d5c1041106a96fc28acfd32320"} Jun 09 14:47:27.607316 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:27.607268 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-m7wbd" podStartSLOduration=2.320211127 podStartE2EDuration="5.607254946s" totalImagesPullingTime="3.287043819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:27.606947453 +0000 UTC m=+629.090222184" watchObservedRunningTime="2026-06-09 14:47:27.607254946 +0000 UTC m=+629.090529684" Jun 09 14:47:28.703285 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.703259 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:28.788771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.788736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle\") pod \"28fd7349-1e35-4173-be0a-8d81c515cdf4\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " Jun 09 14:47:28.788937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.788828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util\") pod \"28fd7349-1e35-4173-be0a-8d81c515cdf4\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " Jun 09 14:47:28.788937 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.788898 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rp5g\" (UniqueName: \"kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g\") pod \"28fd7349-1e35-4173-be0a-8d81c515cdf4\" (UID: \"28fd7349-1e35-4173-be0a-8d81c515cdf4\") " Jun 09 14:47:28.789654 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.789635 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle" (OuterVolumeSpecName: "bundle") pod "28fd7349-1e35-4173-be0a-8d81c515cdf4" (UID: "28fd7349-1e35-4173-be0a-8d81c515cdf4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:47:28.791216 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.791190 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g" (OuterVolumeSpecName: "kube-api-access-9rp5g") pod "28fd7349-1e35-4173-be0a-8d81c515cdf4" (UID: "28fd7349-1e35-4173-be0a-8d81c515cdf4"). InnerVolumeSpecName "kube-api-access-9rp5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:47:28.794206 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.794173 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util" (OuterVolumeSpecName: "util") pod "28fd7349-1e35-4173-be0a-8d81c515cdf4" (UID: "28fd7349-1e35-4173-be0a-8d81c515cdf4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:47:28.890211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.890180 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:28.890211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.890207 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rp5g\" (UniqueName: \"kubernetes.io/projected/28fd7349-1e35-4173-be0a-8d81c515cdf4-kube-api-access-9rp5g\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:28.890211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:28.890217 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28fd7349-1e35-4173-be0a-8d81c515cdf4-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:29.584809 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:29.584782 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" Jun 09 14:47:29.584979 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:29.584812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qsf5v" event={"ID":"28fd7349-1e35-4173-be0a-8d81c515cdf4","Type":"ContainerDied","Data":"d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681"} Jun 09 14:47:29.584979 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:29.584857 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d916e7491f2a8b6140f7c7abdbce24c92641f72929a9061a6690319e2743d681" Jun 09 14:47:34.548822 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:34.548784 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6fc4b59877-r6fbg" Jun 09 14:47:37.437689 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.437654 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb"] Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438018 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="extract" Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438029 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="extract" Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438044 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="pull" Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438051 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="pull" Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438064 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="util" Jun 09 14:47:37.438069 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438070 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="util" Jun 09 14:47:37.438304 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.438165 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28fd7349-1e35-4173-be0a-8d81c515cdf4" containerName="extract" Jun 09 14:47:37.441406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.441388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.448626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.448604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:47:37.448727 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.448684 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:47:37.449571 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.449557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:47:37.476436 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.476395 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb"] Jun 09 14:47:37.570730 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.570693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99s8s\" (UniqueName: \"kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.570922 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.570749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.570922 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.570821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.671899 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.671859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.672067 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.671907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.672067 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.671970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99s8s\" (UniqueName: \"kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.672287 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.672268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.672380 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.672358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.721708 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.721632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99s8s\" (UniqueName: \"kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:37.750343 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:37.750307 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:38.012530 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:38.012505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb"] Jun 09 14:47:38.014861 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:47:38.014824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ec0f09_f495_4cb5_8605_087dcc4c0bab.slice/crio-ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0 WatchSource:0}: Error finding container ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0: Status 404 returned error can't find the container with id ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0 Jun 09 14:47:38.642124 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:38.642070 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerID="66c7c53c96379a981394c23d1471ddfe49303b7baba52ea520e452985e64c501" exitCode=0 Jun 09 14:47:38.642713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:38.642157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" event={"ID":"d4ec0f09-f495-4cb5-8605-087dcc4c0bab","Type":"ContainerDied","Data":"66c7c53c96379a981394c23d1471ddfe49303b7baba52ea520e452985e64c501"} Jun 09 14:47:38.642713 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:38.642205 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" event={"ID":"d4ec0f09-f495-4cb5-8605-087dcc4c0bab","Type":"ContainerStarted","Data":"ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0"} Jun 09 14:47:54.738437 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:54.738395 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerID="1d18f56fd5d6a0ceea5bb6cf0d8d81ef05e1450d9ad91bc412670fd54b155f06" exitCode=0 Jun 09 14:47:54.738853 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:54.738453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" event={"ID":"d4ec0f09-f495-4cb5-8605-087dcc4c0bab","Type":"ContainerDied","Data":"1d18f56fd5d6a0ceea5bb6cf0d8d81ef05e1450d9ad91bc412670fd54b155f06"} Jun 09 14:47:55.745259 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:55.745225 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerID="17f38290119010766551d6a6dfbb4d5a5b097e140b2db944a771fd368d2525cd" exitCode=0 Jun 09 14:47:55.745657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:55.745314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" event={"ID":"d4ec0f09-f495-4cb5-8605-087dcc4c0bab","Type":"ContainerDied","Data":"17f38290119010766551d6a6dfbb4d5a5b097e140b2db944a771fd368d2525cd"} Jun 09 14:47:56.886814 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.886784 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:56.944368 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.944335 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle\") pod \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " Jun 09 14:47:56.944551 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.944435 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99s8s\" (UniqueName: \"kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s\") pod \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " Jun 09 14:47:56.944551 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.944475 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util\") pod \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\" (UID: \"d4ec0f09-f495-4cb5-8605-087dcc4c0bab\") " Jun 09 14:47:56.945560 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.945528 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle" (OuterVolumeSpecName: "bundle") pod "d4ec0f09-f495-4cb5-8605-087dcc4c0bab" (UID: "d4ec0f09-f495-4cb5-8605-087dcc4c0bab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:47:56.946863 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.946835 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s" (OuterVolumeSpecName: "kube-api-access-99s8s") pod "d4ec0f09-f495-4cb5-8605-087dcc4c0bab" (UID: "d4ec0f09-f495-4cb5-8605-087dcc4c0bab"). InnerVolumeSpecName "kube-api-access-99s8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:47:56.949219 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:56.949197 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util" (OuterVolumeSpecName: "util") pod "d4ec0f09-f495-4cb5-8605-087dcc4c0bab" (UID: "d4ec0f09-f495-4cb5-8605-087dcc4c0bab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:47:57.045414 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.045328 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99s8s\" (UniqueName: \"kubernetes.io/projected/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-kube-api-access-99s8s\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:57.045414 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.045352 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:57.045414 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.045361 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4ec0f09-f495-4cb5-8605-087dcc4c0bab-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:47:57.757871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.757844 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" Jun 09 14:47:57.758058 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.757870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762an95nb" event={"ID":"d4ec0f09-f495-4cb5-8605-087dcc4c0bab","Type":"ContainerDied","Data":"ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0"} Jun 09 14:47:57.758058 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:47:57.757922 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec0bf481158c14970ec52b2797ed7ca952c91f1858b99c1baf79c289669a33f0" Jun 09 14:48:05.870248 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870212 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-757754c85d-r28m8"] Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870731 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="extract" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870746 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="extract" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870775 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="pull" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870785 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="pull" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870812 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="util" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870820 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="util" Jun 09 14:48:05.871019 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.870911 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ec0f09-f495-4cb5-8605-087dcc4c0bab" containerName="extract" Jun 09 14:48:05.877576 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.877555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.886553 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.886523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757754c85d-r28m8"] Jun 09 14:48:05.927232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-trusted-ca-bundle\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-oauth-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-console-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-service-ca\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-oauth-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:05.927510 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:05.927407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ddx\" (UniqueName: \"kubernetes.io/projected/e86725b9-3496-4d01-a259-34b942421cc2-kube-api-access-45ddx\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.027875 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.027836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-service-ca\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.027875 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.027873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.027902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-oauth-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.027940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ddx\" (UniqueName: \"kubernetes.io/projected/e86725b9-3496-4d01-a259-34b942421cc2-kube-api-access-45ddx\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.027984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-trusted-ca-bundle\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.028021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-oauth-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028168 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.028067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-console-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028696 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.028665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-service-ca\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028829 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.028740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-oauth-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.028829 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.028798 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-trusted-ca-bundle\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.029046 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.029022 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e86725b9-3496-4d01-a259-34b942421cc2-console-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.030629 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.030602 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-serving-cert\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.030745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.030727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e86725b9-3496-4d01-a259-34b942421cc2-console-oauth-config\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.035618 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.035597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ddx\" (UniqueName: \"kubernetes.io/projected/e86725b9-3496-4d01-a259-34b942421cc2-kube-api-access-45ddx\") pod \"console-757754c85d-r28m8\" (UID: \"e86725b9-3496-4d01-a259-34b942421cc2\") " pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.189279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.189193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:06.327470 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.327437 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757754c85d-r28m8"] Jun 09 14:48:06.331076 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:48:06.331049 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86725b9_3496_4d01_a259_34b942421cc2.slice/crio-427baa6c6f1cfbbec9f7bb4214ca05d917909355d9639a7b32737f9aabb19073 WatchSource:0}: Error finding container 427baa6c6f1cfbbec9f7bb4214ca05d917909355d9639a7b32737f9aabb19073: Status 404 returned error can't find the container with id 427baa6c6f1cfbbec9f7bb4214ca05d917909355d9639a7b32737f9aabb19073 Jun 09 14:48:06.804906 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.804871 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757754c85d-r28m8" event={"ID":"e86725b9-3496-4d01-a259-34b942421cc2","Type":"ContainerStarted","Data":"6ee107cd91fd59bb5898cb63319cdcf19441a1c884113e64913324420de05d7f"} Jun 09 14:48:06.805148 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.804925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757754c85d-r28m8" event={"ID":"e86725b9-3496-4d01-a259-34b942421cc2","Type":"ContainerStarted","Data":"427baa6c6f1cfbbec9f7bb4214ca05d917909355d9639a7b32737f9aabb19073"} Jun 09 14:48:06.824548 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:06.824494 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-757754c85d-r28m8" podStartSLOduration=1.8244786899999998 podStartE2EDuration="1.82447869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:48:06.822510926 +0000 UTC m=+668.305785659" watchObservedRunningTime="2026-06-09 14:48:06.82447869 +0000 UTC m=+668.307753427" Jun 09 14:48:16.190042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:16.189995 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:16.190042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:16.190056 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:16.194958 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:16.194936 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:16.859834 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:16.859802 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-757754c85d-r28m8" Jun 09 14:48:16.906540 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:16.906510 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:48:38.924606 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.924514 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt"] Jun 09 14:48:38.928362 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.928337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:38.931296 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.931274 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 14:48:38.931416 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.931278 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 14:48:38.932123 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.932105 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxnd5\"" Jun 09 14:48:38.937618 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:38.937596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt"] Jun 09 14:48:39.032055 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.032021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbn4d\" (UniqueName: \"kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.032254 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.032066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.032254 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.032134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.133476 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.133437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.133678 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.133506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.133819 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.133795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbn4d\" (UniqueName: \"kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.133949 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.133925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.134030 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.133952 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.143576 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.143546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbn4d\" (UniqueName: \"kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.238785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.238703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:39.356932 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.356902 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj"] Jun 09 14:48:39.361701 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.361682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.369992 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.369947 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj"] Jun 09 14:48:39.374033 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.374008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt"] Jun 09 14:48:39.375901 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:48:39.375879 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342c8a3a_2a03_4b11_b655_1041b9c867ac.slice/crio-9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016 WatchSource:0}: Error finding container 9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016: Status 404 returned error can't find the container with id 9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016 Jun 09 14:48:39.437048 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.437017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.437190 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.437166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g28zn\" (UniqueName: \"kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.437260 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.437225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.538594 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.538508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.538594 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.538566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g28zn\" (UniqueName: \"kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.538817 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.538609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.538967 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.538945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.539042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.539021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.547407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.547382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g28zn\" (UniqueName: \"kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.675269 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.675230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:39.742723 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.742695 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646"] Jun 09 14:48:39.746593 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.746572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.755762 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.755739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646"] Jun 09 14:48:39.810698 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.810617 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj"] Jun 09 14:48:39.813253 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:48:39.813225 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59654a99_80a5_4143_9259_c1aa54166a65.slice/crio-6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693 WatchSource:0}: Error finding container 6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693: Status 404 returned error can't find the container with id 6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693 Jun 09 14:48:39.840439 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.840415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbflp\" (UniqueName: \"kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.840530 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.840494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.840530 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.840521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.941037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.941005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbflp\" (UniqueName: \"kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.941391 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.941136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.941391 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.941179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.941504 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.941488 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.941545 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.941528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.949426 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.949403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbflp\" (UniqueName: \"kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:39.986833 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.986805 2564 generic.go:356] "Generic (PLEG): container finished" podID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerID="a2b12f3a1136620d7e58e808bfcba7d06d02e2b1e7b2d06747e3d874c04d3906" exitCode=0 Jun 09 14:48:39.986993 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.986838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" event={"ID":"342c8a3a-2a03-4b11-b655-1041b9c867ac","Type":"ContainerDied","Data":"a2b12f3a1136620d7e58e808bfcba7d06d02e2b1e7b2d06747e3d874c04d3906"} Jun 09 14:48:39.986993 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.986894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" event={"ID":"342c8a3a-2a03-4b11-b655-1041b9c867ac","Type":"ContainerStarted","Data":"9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016"} Jun 09 14:48:39.987430 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.987414 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:48:39.988524 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.988502 2564 generic.go:356] "Generic (PLEG): container finished" podID="59654a99-80a5-4143-9259-c1aa54166a65" containerID="e30338cd8e94bc7e5676b5e18a34d469dab818becb5ad7534d4fcbc7a2c1632a" exitCode=0 Jun 09 14:48:39.988619 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.988583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" event={"ID":"59654a99-80a5-4143-9259-c1aa54166a65","Type":"ContainerDied","Data":"e30338cd8e94bc7e5676b5e18a34d469dab818becb5ad7534d4fcbc7a2c1632a"} Jun 09 14:48:39.988660 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:39.988619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" event={"ID":"59654a99-80a5-4143-9259-c1aa54166a65","Type":"ContainerStarted","Data":"6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693"} Jun 09 14:48:40.057586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.057554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:40.122856 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.122827 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl"] Jun 09 14:48:40.126854 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.126835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.135072 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.135050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl"] Jun 09 14:48:40.202695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.202669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646"] Jun 09 14:48:40.204852 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:48:40.204827 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d91d0a_0a8d_4477_90f0_12bfc48c1f94.slice/crio-2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454 WatchSource:0}: Error finding container 2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454: Status 404 returned error can't find the container with id 2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454 Jun 09 14:48:40.244570 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.244530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.244570 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.244565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwp7\" (UniqueName: \"kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.244759 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.244663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.345688 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.345661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.345877 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.345725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.345877 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.345753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwp7\" (UniqueName: \"kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.346054 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.346032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.346054 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.346044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.355346 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.355323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwp7\" (UniqueName: \"kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.437404 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.437364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:40.577241 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.577214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl"] Jun 09 14:48:40.583234 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:48:40.583203 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7783b628_482b_4a93_b28c_d82daad7ffcf.slice/crio-6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff WatchSource:0}: Error finding container 6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff: Status 404 returned error can't find the container with id 6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff Jun 09 14:48:40.997576 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.997544 2564 generic.go:356] "Generic (PLEG): container finished" podID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerID="d86d77b50a50123f663257e0e6891a839fd274e4595a7a7bd2cfbf82a89974d0" exitCode=0 Jun 09 14:48:40.998010 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.997618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" event={"ID":"342c8a3a-2a03-4b11-b655-1041b9c867ac","Type":"ContainerDied","Data":"d86d77b50a50123f663257e0e6891a839fd274e4595a7a7bd2cfbf82a89974d0"} Jun 09 14:48:40.999344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.999222 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerID="40fe4334b57e510e74f1630472784aea188296f1340fa48cdc73ae1512fa79b8" exitCode=0 Jun 09 14:48:40.999344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.999279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" event={"ID":"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94","Type":"ContainerDied","Data":"40fe4334b57e510e74f1630472784aea188296f1340fa48cdc73ae1512fa79b8"} Jun 09 14:48:40.999344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:40.999327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" event={"ID":"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94","Type":"ContainerStarted","Data":"2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454"} Jun 09 14:48:41.001198 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.001178 2564 generic.go:356] "Generic (PLEG): container finished" podID="59654a99-80a5-4143-9259-c1aa54166a65" containerID="38c22bd722c23fb54b473ab981654ccc702c5656a8d8cd892778fba3460d1753" exitCode=0 Jun 09 14:48:41.001338 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.001282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" event={"ID":"59654a99-80a5-4143-9259-c1aa54166a65","Type":"ContainerDied","Data":"38c22bd722c23fb54b473ab981654ccc702c5656a8d8cd892778fba3460d1753"} Jun 09 14:48:41.003060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.003033 2564 generic.go:356] "Generic (PLEG): container finished" podID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerID="7d55b07ccf82b1798a79a57e4a4794db0c4010f7d3c6cb487e8cce836e0f38f2" exitCode=0 Jun 09 14:48:41.003169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.003065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" event={"ID":"7783b628-482b-4a93-b28c-d82daad7ffcf","Type":"ContainerDied","Data":"7d55b07ccf82b1798a79a57e4a4794db0c4010f7d3c6cb487e8cce836e0f38f2"} Jun 09 14:48:41.003169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.003120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" event={"ID":"7783b628-482b-4a93-b28c-d82daad7ffcf","Type":"ContainerStarted","Data":"6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff"} Jun 09 14:48:41.927955 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:41.927918 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75869899f5-9vjhm" podUID="57196f75-46a0-480a-9861-484e9955a872" containerName="console" containerID="cri-o://db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096" gracePeriod=15 Jun 09 14:48:42.013100 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.013050 2564 generic.go:356] "Generic (PLEG): container finished" podID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerID="eac7e1d63f934785b0662b4640e8c15029ab04feebb817f32dfbb3dbc3e276e5" exitCode=0 Jun 09 14:48:42.013448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.013157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" event={"ID":"342c8a3a-2a03-4b11-b655-1041b9c867ac","Type":"ContainerDied","Data":"eac7e1d63f934785b0662b4640e8c15029ab04feebb817f32dfbb3dbc3e276e5"} Jun 09 14:48:42.017206 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.017182 2564 generic.go:356] "Generic (PLEG): container finished" podID="59654a99-80a5-4143-9259-c1aa54166a65" containerID="dea97770739204fc516d56b91381d495ae0e7ecfb13c7a0f335d1c8f2d81a9fb" exitCode=0 Jun 09 14:48:42.017322 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.017267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" event={"ID":"59654a99-80a5-4143-9259-c1aa54166a65","Type":"ContainerDied","Data":"dea97770739204fc516d56b91381d495ae0e7ecfb13c7a0f335d1c8f2d81a9fb"} Jun 09 14:48:42.156205 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.156179 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:48:42.263358 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263327 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzv8k\" (UniqueName: \"kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263532 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263367 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263532 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263532 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263438 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263625 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263738 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263687 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263794 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263766 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca\") pod \"57196f75-46a0-480a-9861-484e9955a872\" (UID: \"57196f75-46a0-480a-9861-484e9955a872\") " Jun 09 14:48:42.263925 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.263805 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config" (OuterVolumeSpecName: "console-config") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:48:42.264029 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.264010 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:48:42.264158 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.264141 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-trusted-ca-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.264234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.264164 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-console-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.264291 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.264273 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca" (OuterVolumeSpecName: "service-ca") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:48:42.264365 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.264340 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:48:42.265678 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.265659 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:48:42.266282 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.266261 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:48:42.266350 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.266280 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k" (OuterVolumeSpecName: "kube-api-access-jzv8k") pod "57196f75-46a0-480a-9861-484e9955a872" (UID: "57196f75-46a0-480a-9861-484e9955a872"). InnerVolumeSpecName "kube-api-access-jzv8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:48:42.364997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.364950 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-service-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.364997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.364987 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzv8k\" (UniqueName: \"kubernetes.io/projected/57196f75-46a0-480a-9861-484e9955a872-kube-api-access-jzv8k\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.364997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.365002 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-oauth-config\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.365280 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.365014 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57196f75-46a0-480a-9861-484e9955a872-console-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:42.365280 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:42.365027 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57196f75-46a0-480a-9861-484e9955a872-oauth-serving-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.024378 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.024348 2564 generic.go:356] "Generic (PLEG): container finished" podID="57196f75-46a0-480a-9861-484e9955a872" containerID="db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096" exitCode=0 Jun 09 14:48:43.024832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.024396 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75869899f5-9vjhm" Jun 09 14:48:43.024832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.024437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75869899f5-9vjhm" event={"ID":"57196f75-46a0-480a-9861-484e9955a872","Type":"ContainerDied","Data":"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096"} Jun 09 14:48:43.024832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.024492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75869899f5-9vjhm" event={"ID":"57196f75-46a0-480a-9861-484e9955a872","Type":"ContainerDied","Data":"84f03f2f07a5acd9090332978bcaf86db1365cdb14ae4d81534125e8f12c9777"} Jun 09 14:48:43.024832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.024521 2564 scope.go:117] "RemoveContainer" containerID="db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096" Jun 09 14:48:43.026594 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.026565 2564 generic.go:356] "Generic (PLEG): container finished" podID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerID="3efa25363fe3c85f388300382d301e182804a195f0beb2b5ec580e18b670127f" exitCode=0 Jun 09 14:48:43.026718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.026693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" event={"ID":"7783b628-482b-4a93-b28c-d82daad7ffcf","Type":"ContainerDied","Data":"3efa25363fe3c85f388300382d301e182804a195f0beb2b5ec580e18b670127f"} Jun 09 14:48:43.028865 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.028840 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerID="693975f6bb27fdaad99747c9cf2e804c4019af88dc458fbd2dec216b0595a319" exitCode=0 Jun 09 14:48:43.029029 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.028895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" event={"ID":"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94","Type":"ContainerDied","Data":"693975f6bb27fdaad99747c9cf2e804c4019af88dc458fbd2dec216b0595a319"} Jun 09 14:48:43.036785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.036753 2564 scope.go:117] "RemoveContainer" containerID="db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096" Jun 09 14:48:43.037189 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:48:43.037065 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096\": container with ID starting with db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096 not found: ID does not exist" containerID="db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096" Jun 09 14:48:43.037189 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.037114 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096"} err="failed to get container status \"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096\": rpc error: code = NotFound desc = could not find container \"db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096\": container with ID starting with db7b12ae0ca60b74f9644d65c1ef9000a25498192030090becc373d1cefa2096 not found: ID does not exist" Jun 09 14:48:43.075450 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.075408 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:48:43.077613 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.077591 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75869899f5-9vjhm"] Jun 09 14:48:43.163559 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.163529 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:43.274026 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.274001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g28zn\" (UniqueName: \"kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn\") pod \"59654a99-80a5-4143-9259-c1aa54166a65\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " Jun 09 14:48:43.274153 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.274066 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util\") pod \"59654a99-80a5-4143-9259-c1aa54166a65\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " Jun 09 14:48:43.274239 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.274225 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle\") pod \"59654a99-80a5-4143-9259-c1aa54166a65\" (UID: \"59654a99-80a5-4143-9259-c1aa54166a65\") " Jun 09 14:48:43.274635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.274583 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle" (OuterVolumeSpecName: "bundle") pod "59654a99-80a5-4143-9259-c1aa54166a65" (UID: "59654a99-80a5-4143-9259-c1aa54166a65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:43.276282 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.276260 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn" (OuterVolumeSpecName: "kube-api-access-g28zn") pod "59654a99-80a5-4143-9259-c1aa54166a65" (UID: "59654a99-80a5-4143-9259-c1aa54166a65"). InnerVolumeSpecName "kube-api-access-g28zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:48:43.279290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.279258 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util" (OuterVolumeSpecName: "util") pod "59654a99-80a5-4143-9259-c1aa54166a65" (UID: "59654a99-80a5-4143-9259-c1aa54166a65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:43.331491 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.331468 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:43.375687 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375663 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbn4d\" (UniqueName: \"kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d\") pod \"342c8a3a-2a03-4b11-b655-1041b9c867ac\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " Jun 09 14:48:43.375823 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375695 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle\") pod \"342c8a3a-2a03-4b11-b655-1041b9c867ac\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " Jun 09 14:48:43.375823 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375753 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util\") pod \"342c8a3a-2a03-4b11-b655-1041b9c867ac\" (UID: \"342c8a3a-2a03-4b11-b655-1041b9c867ac\") " Jun 09 14:48:43.375911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375900 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.375966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375913 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g28zn\" (UniqueName: \"kubernetes.io/projected/59654a99-80a5-4143-9259-c1aa54166a65-kube-api-access-g28zn\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.375966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.375922 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59654a99-80a5-4143-9259-c1aa54166a65-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.376270 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.376241 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle" (OuterVolumeSpecName: "bundle") pod "342c8a3a-2a03-4b11-b655-1041b9c867ac" (UID: "342c8a3a-2a03-4b11-b655-1041b9c867ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:43.377923 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.377897 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d" (OuterVolumeSpecName: "kube-api-access-kbn4d") pod "342c8a3a-2a03-4b11-b655-1041b9c867ac" (UID: "342c8a3a-2a03-4b11-b655-1041b9c867ac"). InnerVolumeSpecName "kube-api-access-kbn4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:48:43.381272 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.381249 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util" (OuterVolumeSpecName: "util") pod "342c8a3a-2a03-4b11-b655-1041b9c867ac" (UID: "342c8a3a-2a03-4b11-b655-1041b9c867ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:43.477010 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.476962 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbn4d\" (UniqueName: \"kubernetes.io/projected/342c8a3a-2a03-4b11-b655-1041b9c867ac-kube-api-access-kbn4d\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.477010 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.477006 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:43.477010 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:43.477015 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/342c8a3a-2a03-4b11-b655-1041b9c867ac-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:44.036897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.036866 2564 generic.go:356] "Generic (PLEG): container finished" podID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerID="a04ab59d240d10200828ff3c603df2be7748068b7bacb03d00a6644e1634b7d3" exitCode=0 Jun 09 14:48:44.037328 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.036958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" event={"ID":"7783b628-482b-4a93-b28c-d82daad7ffcf","Type":"ContainerDied","Data":"a04ab59d240d10200828ff3c603df2be7748068b7bacb03d00a6644e1634b7d3"} Jun 09 14:48:44.038814 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.038797 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" Jun 09 14:48:44.038936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.038793 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt" event={"ID":"342c8a3a-2a03-4b11-b655-1041b9c867ac","Type":"ContainerDied","Data":"9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016"} Jun 09 14:48:44.038936 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.038911 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9219ecab3cc340cc114336cd9a2198b82a335478f72a7acf93c7af489f1de016" Jun 09 14:48:44.041156 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.041135 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerID="f72821eb6e93a41cb0d6e67c6302f4c97e82da7e21569f214a52fea815a5d118" exitCode=0 Jun 09 14:48:44.041231 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.041203 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" event={"ID":"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94","Type":"ContainerDied","Data":"f72821eb6e93a41cb0d6e67c6302f4c97e82da7e21569f214a52fea815a5d118"} Jun 09 14:48:44.043076 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.043052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" event={"ID":"59654a99-80a5-4143-9259-c1aa54166a65","Type":"ContainerDied","Data":"6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693"} Jun 09 14:48:44.043076 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.043072 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj" Jun 09 14:48:44.043213 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:44.043080 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6940d324e8d40760f10c1365210914e6db10645a349da42db40dc3d7c13f4693" Jun 09 14:48:45.044580 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.044547 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57196f75-46a0-480a-9861-484e9955a872" path="/var/lib/kubelet/pods/57196f75-46a0-480a-9861-484e9955a872/volumes" Jun 09 14:48:45.183116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.183078 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:45.215454 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.215429 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:45.292739 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292710 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle\") pod \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " Jun 09 14:48:45.292924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util\") pod \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " Jun 09 14:48:45.292924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292813 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util\") pod \"7783b628-482b-4a93-b28c-d82daad7ffcf\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " Jun 09 14:48:45.292924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292843 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbflp\" (UniqueName: \"kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp\") pod \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\" (UID: \"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94\") " Jun 09 14:48:45.292924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292872 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cwp7\" (UniqueName: \"kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7\") pod \"7783b628-482b-4a93-b28c-d82daad7ffcf\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " Jun 09 14:48:45.292924 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.292891 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle\") pod \"7783b628-482b-4a93-b28c-d82daad7ffcf\" (UID: \"7783b628-482b-4a93-b28c-d82daad7ffcf\") " Jun 09 14:48:45.293438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.293408 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle" (OuterVolumeSpecName: "bundle") pod "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" (UID: "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:45.293632 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.293602 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle" (OuterVolumeSpecName: "bundle") pod "7783b628-482b-4a93-b28c-d82daad7ffcf" (UID: "7783b628-482b-4a93-b28c-d82daad7ffcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:45.295135 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.295064 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp" (OuterVolumeSpecName: "kube-api-access-lbflp") pod "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" (UID: "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94"). InnerVolumeSpecName "kube-api-access-lbflp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:48:45.295465 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.295441 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7" (OuterVolumeSpecName: "kube-api-access-4cwp7") pod "7783b628-482b-4a93-b28c-d82daad7ffcf" (UID: "7783b628-482b-4a93-b28c-d82daad7ffcf"). InnerVolumeSpecName "kube-api-access-4cwp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:48:45.298753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.298726 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util" (OuterVolumeSpecName: "util") pod "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" (UID: "d4d91d0a-0a8d-4477-90f0-12bfc48c1f94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:45.299342 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.299317 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util" (OuterVolumeSpecName: "util") pod "7783b628-482b-4a93-b28c-d82daad7ffcf" (UID: "7783b628-482b-4a93-b28c-d82daad7ffcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:48:45.394219 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394186 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbflp\" (UniqueName: \"kubernetes.io/projected/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-kube-api-access-lbflp\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:45.394219 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394215 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cwp7\" (UniqueName: \"kubernetes.io/projected/7783b628-482b-4a93-b28c-d82daad7ffcf-kube-api-access-4cwp7\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:45.394219 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394225 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:45.394427 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394233 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:45.394427 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394240 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4d91d0a-0a8d-4477-90f0-12bfc48c1f94-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:45.394427 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:45.394247 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7783b628-482b-4a93-b28c-d82daad7ffcf-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:48:46.058960 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.058926 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" Jun 09 14:48:46.058960 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.058950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl" event={"ID":"7783b628-482b-4a93-b28c-d82daad7ffcf","Type":"ContainerDied","Data":"6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff"} Jun 09 14:48:46.059482 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.058998 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6226ffd3c96ad33a5c1d7db76c375539c38c4d2930e154a9334dd361f22d96ff" Jun 09 14:48:46.060847 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.060829 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" Jun 09 14:48:46.060847 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.060838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646" event={"ID":"d4d91d0a-0a8d-4477-90f0-12bfc48c1f94","Type":"ContainerDied","Data":"2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454"} Jun 09 14:48:46.060991 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:48:46.060869 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2374725518d0baf08548ea241bcdc05413a92c5d75e3ccc4e555e0dc0e0d7454" Jun 09 14:49:07.328205 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328166 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v"] Jun 09 14:49:07.328695 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328675 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="util" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328700 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="util" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328714 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="pull" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328723 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="pull" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328736 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="util" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328747 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="util" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328760 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="extract" Jun 09 14:49:07.328771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328769 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328781 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328788 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328802 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="util" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328810 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="util" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328826 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328833 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328845 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57196f75-46a0-480a-9861-484e9955a872" containerName="console" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328854 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="57196f75-46a0-480a-9861-484e9955a872" containerName="console" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328864 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328873 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328885 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328893 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328904 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328911 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="pull" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328923 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="util" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328931 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="util" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328944 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.328954 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.329043 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="57196f75-46a0-480a-9861-484e9955a872" containerName="console" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.329054 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59654a99-80a5-4143-9259-c1aa54166a65" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.329066 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7783b628-482b-4a93-b28c-d82daad7ffcf" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.329075 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="342c8a3a-2a03-4b11-b655-1041b9c867ac" containerName="extract" Jun 09 14:49:07.329151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.329104 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d91d0a-0a8d-4477-90f0-12bfc48c1f94" containerName="extract" Jun 09 14:49:07.334428 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.334408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.337763 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.337745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6zqds\"" Jun 09 14:49:07.338011 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.337996 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 14:49:07.338658 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.338644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 14:49:07.361636 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.361610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v"] Jun 09 14:49:07.496828 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.496792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4drp\" (UniqueName: \"kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.497003 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.496838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.597347 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.597258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4drp\" (UniqueName: \"kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.597347 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.597310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.597735 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.597716 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.605694 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.605671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4drp\" (UniqueName: \"kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.644353 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.644310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:07.783448 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:07.783421 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v"] Jun 09 14:49:07.785471 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:49:07.785444 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee0bc4f_46ed_4bce_9d5e_757dd21fad6e.slice/crio-4cbfe58188d9ba22697ac648d0e909d545804613613102c28fc93f62499c5afc WatchSource:0}: Error finding container 4cbfe58188d9ba22697ac648d0e909d545804613613102c28fc93f62499c5afc: Status 404 returned error can't find the container with id 4cbfe58188d9ba22697ac648d0e909d545804613613102c28fc93f62499c5afc Jun 09 14:49:08.177853 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:08.177816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" event={"ID":"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e","Type":"ContainerStarted","Data":"4cbfe58188d9ba22697ac648d0e909d545804613613102c28fc93f62499c5afc"} Jun 09 14:49:16.237916 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:16.237883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" event={"ID":"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e","Type":"ContainerStarted","Data":"1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978"} Jun 09 14:49:16.238496 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:16.238023 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:18.109685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.109617 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" podStartSLOduration=3.552215122 podStartE2EDuration="11.109591313s" totalImagesPullingTime="7.557376191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:16.261965867 +0000 UTC m=+737.745240605" watchObservedRunningTime="2026-06-09 14:49:18.109591313 +0000 UTC m=+739.592866052" Jun 09 14:49:18.111431 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.111403 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl"] Jun 09 14:49:18.115452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.115431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.117879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.117856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 14:49:18.117879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.117870 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 14:49:18.118057 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.117903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxnd5\"" Jun 09 14:49:18.124004 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.123978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl"] Jun 09 14:49:18.182508 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.182473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftp2\" (UniqueName: \"kubernetes.io/projected/e5a75eef-e42e-4138-880a-8f2735f58fbb-kube-api-access-sftp2\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.182694 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.182530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5a75eef-e42e-4138-880a-8f2735f58fbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.182694 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.182627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.283320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.283289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.283483 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.283338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sftp2\" (UniqueName: \"kubernetes.io/projected/e5a75eef-e42e-4138-880a-8f2735f58fbb-kube-api-access-sftp2\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.283483 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.283404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5a75eef-e42e-4138-880a-8f2735f58fbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.283483 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:18.283432 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 14:49:18.283610 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:18.283494 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert podName:e5a75eef-e42e-4138-880a-8f2735f58fbb nodeName:}" failed. No retries permitted until 2026-06-09 14:49:18.783474616 +0000 UTC m=+740.266749424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-v2pwl" (UID: "e5a75eef-e42e-4138-880a-8f2735f58fbb") : secret "plugin-serving-cert" not found Jun 09 14:49:18.284138 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.284119 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5a75eef-e42e-4138-880a-8f2735f58fbb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.292626 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.292594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftp2\" (UniqueName: \"kubernetes.io/projected/e5a75eef-e42e-4138-880a-8f2735f58fbb-kube-api-access-sftp2\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.786997 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.786961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:18.789620 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:18.789597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5a75eef-e42e-4138-880a-8f2735f58fbb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-v2pwl\" (UID: \"e5a75eef-e42e-4138-880a-8f2735f58fbb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:19.026126 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:19.026073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" Jun 09 14:49:19.168496 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:19.168468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl"] Jun 09 14:49:19.170433 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:49:19.170406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5a75eef_e42e_4138_880a_8f2735f58fbb.slice/crio-c998ab01e326d0085a871652f5b070f944858fb945bd8d8a4193c582ecfd8fc1 WatchSource:0}: Error finding container c998ab01e326d0085a871652f5b070f944858fb945bd8d8a4193c582ecfd8fc1: Status 404 returned error can't find the container with id c998ab01e326d0085a871652f5b070f944858fb945bd8d8a4193c582ecfd8fc1 Jun 09 14:49:19.255278 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:19.255243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" event={"ID":"e5a75eef-e42e-4138-880a-8f2735f58fbb","Type":"ContainerStarted","Data":"c998ab01e326d0085a871652f5b070f944858fb945bd8d8a4193c582ecfd8fc1"} Jun 09 14:49:27.246424 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:27.246369 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:29.046781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.046748 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v"] Jun 09 14:49:29.047241 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.046933 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" containerName="manager" containerID="cri-o://1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978" gracePeriod=2 Jun 09 14:49:29.058648 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.058611 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v"] Jun 09 14:49:29.081666 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.081632 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:29.082183 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.082161 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" containerName="manager" Jun 09 14:49:29.082183 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.082182 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" containerName="manager" Jun 09 14:49:29.082368 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.082323 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" containerName="manager" Jun 09 14:49:29.088528 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.088505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.091687 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:29.091645 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" is forbidden: User \"system:node:ip-10-0-143-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-134.ec2.internal' and this object" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:29.110303 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.109464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:29.180425 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.180386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmg4k\" (UniqueName: \"kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.180619 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.180481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.281232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.281120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmg4k\" (UniqueName: \"kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.281232 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.281198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.281682 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.281658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.293383 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.293352 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmg4k\" (UniqueName: \"kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k26vx\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:29.435336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:29.435300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:42.863553 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:42.863528 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:42.865955 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:49:42.865916 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27c9b6d_e6e9_44bd_a7d8_76726187a091.slice/crio-a23d49c70a5cec3c2d4fc4a778970ab306e0d3bf8c4f068944e25f547fb09bec WatchSource:0}: Error finding container a23d49c70a5cec3c2d4fc4a778970ab306e0d3bf8c4f068944e25f547fb09bec: Status 404 returned error can't find the container with id a23d49c70a5cec3c2d4fc4a778970ab306e0d3bf8c4f068944e25f547fb09bec Jun 09 14:49:42.922645 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:42.922613 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:42.924791 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:42.924766 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" is forbidden: User \"system:node:ip-10-0-143-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-134.ec2.internal' and this object" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:43.008651 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.008574 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4drp\" (UniqueName: \"kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp\") pod \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " Jun 09 14:49:43.008651 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.008613 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume\") pod \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\" (UID: \"dee0bc4f-46ed-4bce-9d5e-757dd21fad6e\") " Jun 09 14:49:43.009143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.009120 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" (UID: "dee0bc4f-46ed-4bce-9d5e-757dd21fad6e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:49:43.010773 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.010753 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp" (OuterVolumeSpecName: "kube-api-access-x4drp") pod "dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" (UID: "dee0bc4f-46ed-4bce-9d5e-757dd21fad6e"). InnerVolumeSpecName "kube-api-access-x4drp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:49:43.044394 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.044362 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" path="/var/lib/kubelet/pods/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e/volumes" Jun 09 14:49:43.110336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.110293 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4drp\" (UniqueName: \"kubernetes.io/projected/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-kube-api-access-x4drp\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:49:43.110336 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.110334 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dee0bc4f-46ed-4bce-9d5e-757dd21fad6e-extensions-socket-volume\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:49:43.412446 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.412405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" event={"ID":"b27c9b6d-e6e9-44bd-a7d8-76726187a091","Type":"ContainerStarted","Data":"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e"} Jun 09 14:49:43.412644 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.412467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" event={"ID":"b27c9b6d-e6e9-44bd-a7d8-76726187a091","Type":"ContainerStarted","Data":"a23d49c70a5cec3c2d4fc4a778970ab306e0d3bf8c4f068944e25f547fb09bec"} Jun 09 14:49:43.412644 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.412599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:43.413871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.413847 2564 generic.go:356] "Generic (PLEG): container finished" podID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" containerID="1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978" exitCode=0 Jun 09 14:49:43.414008 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.413886 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:43.414008 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.413910 2564 scope.go:117] "RemoveContainer" containerID="1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978" Jun 09 14:49:43.420961 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.420666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" event={"ID":"e5a75eef-e42e-4138-880a-8f2735f58fbb","Type":"ContainerStarted","Data":"db7fd5dcba2491b3745d51cdb9c7da3bc1dc69d031988c767e6ebb72813f31fc"} Jun 09 14:49:43.427498 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.427476 2564 scope.go:117] "RemoveContainer" containerID="1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978" Jun 09 14:49:43.427760 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:43.427741 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978\": container with ID starting with 1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978 not found: ID does not exist" containerID="1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978" Jun 09 14:49:43.427810 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.427768 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978"} err="failed to get container status \"1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978\": rpc error: code = NotFound desc = could not find container \"1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978\": container with ID starting with 1d43feb677427d79a2d3996b6c7f3f58ceb3b3a3cc9680c88bca2046f46c7978 not found: ID does not exist" Jun 09 14:49:43.433841 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:43.433810 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brn7v\" is forbidden: User \"system:node:ip-10-0-143-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-134.ec2.internal' and this object" podUID="dee0bc4f-46ed-4bce-9d5e-757dd21fad6e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brn7v" Jun 09 14:49:43.434481 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.434445 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" podStartSLOduration=14.43443236 podStartE2EDuration="14.43443236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:43.431707533 +0000 UTC m=+764.914982284" watchObservedRunningTime="2026-06-09 14:49:43.43443236 +0000 UTC m=+764.917707097" Jun 09 14:49:43.453590 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:43.453525 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-v2pwl" podStartSLOduration=1.457694164 podStartE2EDuration="25.453503752s" totalImagesPullingTime="23.995809588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:43.450109239 +0000 UTC m=+764.933383969" watchObservedRunningTime="2026-06-09 14:49:43.453503752 +0000 UTC m=+764.936778507" Jun 09 14:49:44.980076 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:44.980022 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:45.434150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.434110 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" podUID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" containerName="manager" containerID="cri-o://56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e" gracePeriod=10 Jun 09 14:49:45.722944 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.722903 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:45.834048 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.834017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmg4k\" (UniqueName: \"kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k\") pod \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " Jun 09 14:49:45.834249 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.834108 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume\") pod \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\" (UID: \"b27c9b6d-e6e9-44bd-a7d8-76726187a091\") " Jun 09 14:49:45.834514 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.834491 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b27c9b6d-e6e9-44bd-a7d8-76726187a091" (UID: "b27c9b6d-e6e9-44bd-a7d8-76726187a091"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:49:45.836394 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.836370 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k" (OuterVolumeSpecName: "kube-api-access-nmg4k") pod "b27c9b6d-e6e9-44bd-a7d8-76726187a091" (UID: "b27c9b6d-e6e9-44bd-a7d8-76726187a091"). InnerVolumeSpecName "kube-api-access-nmg4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:49:45.935487 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.935454 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b27c9b6d-e6e9-44bd-a7d8-76726187a091-extensions-socket-volume\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:49:45.935487 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:45.935481 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmg4k\" (UniqueName: \"kubernetes.io/projected/b27c9b6d-e6e9-44bd-a7d8-76726187a091-kube-api-access-nmg4k\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:49:46.441444 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.441409 2564 generic.go:356] "Generic (PLEG): container finished" podID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" containerID="56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e" exitCode=0 Jun 09 14:49:46.441831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.441485 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" Jun 09 14:49:46.441831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.441490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" event={"ID":"b27c9b6d-e6e9-44bd-a7d8-76726187a091","Type":"ContainerDied","Data":"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e"} Jun 09 14:49:46.441831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.441563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx" event={"ID":"b27c9b6d-e6e9-44bd-a7d8-76726187a091","Type":"ContainerDied","Data":"a23d49c70a5cec3c2d4fc4a778970ab306e0d3bf8c4f068944e25f547fb09bec"} Jun 09 14:49:46.441831 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.441596 2564 scope.go:117] "RemoveContainer" containerID="56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e" Jun 09 14:49:46.451818 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.451793 2564 scope.go:117] "RemoveContainer" containerID="56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e" Jun 09 14:49:46.452203 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:49:46.452175 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e\": container with ID starting with 56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e not found: ID does not exist" containerID="56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e" Jun 09 14:49:46.452343 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.452213 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e"} err="failed to get container status \"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e\": rpc error: code = NotFound desc = could not find container \"56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e\": container with ID starting with 56406f9892c129bf50bc9b0c357b5e0c867fd2450e4b3d2f50af0fb7d0b73c0e not found: ID does not exist" Jun 09 14:49:46.466415 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.466388 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:46.471721 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:46.471692 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k26vx"] Jun 09 14:49:47.043433 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:49:47.043401 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" path="/var/lib/kubelet/pods/b27c9b6d-e6e9-44bd-a7d8-76726187a091/volumes" Jun 09 14:50:13.910952 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.910909 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:13.911398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.911325 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" containerName="manager" Jun 09 14:50:13.911398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.911338 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" containerName="manager" Jun 09 14:50:13.911476 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.911409 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27c9b6d-e6e9-44bd-a7d8-76726187a091" containerName="manager" Jun 09 14:50:13.970848 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.970804 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:13.971018 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.970905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:13.973528 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:13.973501 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 14:50:14.003129 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.003051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvtq\" (UniqueName: \"kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.003290 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.003264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.004736 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.004716 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:14.104475 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.104436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvtq\" (UniqueName: \"kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.104680 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.104517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.105215 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.105192 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.112519 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.112494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvtq\" (UniqueName: \"kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq\") pod \"limitador-limitador-64c94fd64f-fxkvw\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.283541 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.283450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:14.424832 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.424805 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:14.426161 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:50:14.426127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a30e859_f812_4554_afa8_8094084bcd27.slice/crio-b00b22db35e9e59ce34982a6015bfb134074cab045b3fdf90b118105cac05149 WatchSource:0}: Error finding container b00b22db35e9e59ce34982a6015bfb134074cab045b3fdf90b118105cac05149: Status 404 returned error can't find the container with id b00b22db35e9e59ce34982a6015bfb134074cab045b3fdf90b118105cac05149 Jun 09 14:50:14.601471 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.601435 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" event={"ID":"7a30e859-f812-4554-afa8-8094084bcd27","Type":"ContainerStarted","Data":"b00b22db35e9e59ce34982a6015bfb134074cab045b3fdf90b118105cac05149"} Jun 09 14:50:14.855601 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.855510 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:14.862816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.862777 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:14.867246 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.867220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xcj4s\"" Jun 09 14:50:14.868629 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.868601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:14.912509 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:14.912477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmh7s\" (UniqueName: \"kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s\") pod \"authorino-58cd955675-zvh6b\" (UID: \"0e339388-df7d-4c0e-be17-1b1711e5a70d\") " pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:15.009167 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.009124 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:50:15.012791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.012773 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:50:15.013204 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.013179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmh7s\" (UniqueName: \"kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s\") pod \"authorino-58cd955675-zvh6b\" (UID: \"0e339388-df7d-4c0e-be17-1b1711e5a70d\") " pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:15.019917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.019887 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:50:15.023378 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.023353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmh7s\" (UniqueName: \"kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s\") pod \"authorino-58cd955675-zvh6b\" (UID: \"0e339388-df7d-4c0e-be17-1b1711e5a70d\") " pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:15.114432 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.114337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bss7c\" (UniqueName: \"kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c\") pod \"authorino-75d556bd77-cxklf\" (UID: \"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac\") " pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:50:15.175545 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.175494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:15.215567 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.215445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bss7c\" (UniqueName: \"kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c\") pod \"authorino-75d556bd77-cxklf\" (UID: \"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac\") " pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:50:15.225664 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.225599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bss7c\" (UniqueName: \"kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c\") pod \"authorino-75d556bd77-cxklf\" (UID: \"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac\") " pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:50:15.323679 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.323650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:50:15.359529 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.359488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:15.512657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.512426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:50:15.514463 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:50:15.514414 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad7b8d7d_6130_4fd6_abb3_c8326a11a9ac.slice/crio-ecfa9b948b487e9c8842f62d69e0c975b5626a8d7595a3c08803faf80cfc1fd7 WatchSource:0}: Error finding container ecfa9b948b487e9c8842f62d69e0c975b5626a8d7595a3c08803faf80cfc1fd7: Status 404 returned error can't find the container with id ecfa9b948b487e9c8842f62d69e0c975b5626a8d7595a3c08803faf80cfc1fd7 Jun 09 14:50:15.609745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.609699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cxklf" event={"ID":"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac","Type":"ContainerStarted","Data":"ecfa9b948b487e9c8842f62d69e0c975b5626a8d7595a3c08803faf80cfc1fd7"} Jun 09 14:50:15.611129 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:15.611081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zvh6b" event={"ID":"0e339388-df7d-4c0e-be17-1b1711e5a70d","Type":"ContainerStarted","Data":"ab3c4c26220837a7292cc7a8220796442dfb714ec8e42d20d717aa3efeaad169"} Jun 09 14:50:19.644621 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.644569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cxklf" event={"ID":"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac","Type":"ContainerStarted","Data":"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb"} Jun 09 14:50:19.646780 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.646748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zvh6b" event={"ID":"0e339388-df7d-4c0e-be17-1b1711e5a70d","Type":"ContainerStarted","Data":"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d"} Jun 09 14:50:19.648588 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.648554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" event={"ID":"7a30e859-f812-4554-afa8-8094084bcd27","Type":"ContainerStarted","Data":"2b993856464ad7363af764d9aa70516ef61b6ada2a8506d5146c5e9f82982a0d"} Jun 09 14:50:19.648718 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.648645 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:19.663101 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.663021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cxklf" podStartSLOduration=1.668134591 podStartE2EDuration="5.662998956s" totalImagesPullingTime="3.994864365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:19.659218591 +0000 UTC m=+801.142493331" watchObservedRunningTime="2026-06-09 14:50:19.662998956 +0000 UTC m=+801.146273696" Jun 09 14:50:19.676032 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.675423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zvh6b" podStartSLOduration=1.54155566 podStartE2EDuration="5.675405436s" totalImagesPullingTime="4.133849776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:19.673913706 +0000 UTC m=+801.157188446" watchObservedRunningTime="2026-06-09 14:50:19.675405436 +0000 UTC m=+801.158680177" Jun 09 14:50:19.694702 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.694590 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" podStartSLOduration=1.695644686 podStartE2EDuration="6.694577445s" totalImagesPullingTime="4.998932759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:19.691182215 +0000 UTC m=+801.174456955" watchObservedRunningTime="2026-06-09 14:50:19.694577445 +0000 UTC m=+801.177852182" Jun 09 14:50:19.699882 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:19.699853 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:21.660611 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:21.660566 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zvh6b" podUID="0e339388-df7d-4c0e-be17-1b1711e5a70d" containerName="authorino" containerID="cri-o://81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d" gracePeriod=30 Jun 09 14:50:21.919945 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:21.919880 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:21.984729 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:21.984691 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmh7s\" (UniqueName: \"kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s\") pod \"0e339388-df7d-4c0e-be17-1b1711e5a70d\" (UID: \"0e339388-df7d-4c0e-be17-1b1711e5a70d\") " Jun 09 14:50:21.986941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:21.986912 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s" (OuterVolumeSpecName: "kube-api-access-vmh7s") pod "0e339388-df7d-4c0e-be17-1b1711e5a70d" (UID: "0e339388-df7d-4c0e-be17-1b1711e5a70d"). InnerVolumeSpecName "kube-api-access-vmh7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:50:22.086283 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.086247 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmh7s\" (UniqueName: \"kubernetes.io/projected/0e339388-df7d-4c0e-be17-1b1711e5a70d-kube-api-access-vmh7s\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:22.667582 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.667549 2564 generic.go:356] "Generic (PLEG): container finished" podID="0e339388-df7d-4c0e-be17-1b1711e5a70d" containerID="81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d" exitCode=0 Jun 09 14:50:22.667980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.667592 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zvh6b" Jun 09 14:50:22.667980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.667636 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zvh6b" event={"ID":"0e339388-df7d-4c0e-be17-1b1711e5a70d","Type":"ContainerDied","Data":"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d"} Jun 09 14:50:22.667980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.667673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zvh6b" event={"ID":"0e339388-df7d-4c0e-be17-1b1711e5a70d","Type":"ContainerDied","Data":"ab3c4c26220837a7292cc7a8220796442dfb714ec8e42d20d717aa3efeaad169"} Jun 09 14:50:22.667980 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.667689 2564 scope.go:117] "RemoveContainer" containerID="81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d" Jun 09 14:50:22.678757 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.678725 2564 scope.go:117] "RemoveContainer" containerID="81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d" Jun 09 14:50:22.679375 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:50:22.679341 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d\": container with ID starting with 81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d not found: ID does not exist" containerID="81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d" Jun 09 14:50:22.679489 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.679394 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d"} err="failed to get container status \"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d\": rpc error: code = NotFound desc = could not find container \"81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d\": container with ID starting with 81524e2b23f18bfb3ca1bff4f85d191b821f2e5416d28a2808dc743fd831977d not found: ID does not exist" Jun 09 14:50:22.695013 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.694985 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:22.698229 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:22.698207 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zvh6b"] Jun 09 14:50:23.043846 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:23.043767 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e339388-df7d-4c0e-be17-1b1711e5a70d" path="/var/lib/kubelet/pods/0e339388-df7d-4c0e-be17-1b1711e5a70d/volumes" Jun 09 14:50:29.210391 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.210359 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:29.210804 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.210525 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" podUID="7a30e859-f812-4554-afa8-8094084bcd27" containerName="limitador" containerID="cri-o://2b993856464ad7363af764d9aa70516ef61b6ada2a8506d5146c5e9f82982a0d" gracePeriod=30 Jun 09 14:50:29.211253 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.211238 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:29.711830 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.711792 2564 generic.go:356] "Generic (PLEG): container finished" podID="7a30e859-f812-4554-afa8-8094084bcd27" containerID="2b993856464ad7363af764d9aa70516ef61b6ada2a8506d5146c5e9f82982a0d" exitCode=0 Jun 09 14:50:29.711981 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.711862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" event={"ID":"7a30e859-f812-4554-afa8-8094084bcd27","Type":"ContainerDied","Data":"2b993856464ad7363af764d9aa70516ef61b6ada2a8506d5146c5e9f82982a0d"} Jun 09 14:50:29.761745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.761718 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:29.859401 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.859373 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcvtq\" (UniqueName: \"kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq\") pod \"7a30e859-f812-4554-afa8-8094084bcd27\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " Jun 09 14:50:29.859560 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.859490 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file\") pod \"7a30e859-f812-4554-afa8-8094084bcd27\" (UID: \"7a30e859-f812-4554-afa8-8094084bcd27\") " Jun 09 14:50:29.859830 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.859798 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file" (OuterVolumeSpecName: "config-file") pod "7a30e859-f812-4554-afa8-8094084bcd27" (UID: "7a30e859-f812-4554-afa8-8094084bcd27"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:50:29.861514 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.861497 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq" (OuterVolumeSpecName: "kube-api-access-mcvtq") pod "7a30e859-f812-4554-afa8-8094084bcd27" (UID: "7a30e859-f812-4554-afa8-8094084bcd27"). InnerVolumeSpecName "kube-api-access-mcvtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:50:29.961060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.961028 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a30e859-f812-4554-afa8-8094084bcd27-config-file\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:29.961060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:29.961055 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcvtq\" (UniqueName: \"kubernetes.io/projected/7a30e859-f812-4554-afa8-8094084bcd27-kube-api-access-mcvtq\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:30.718289 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:30.718260 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" Jun 09 14:50:30.718289 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:30.718280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fxkvw" event={"ID":"7a30e859-f812-4554-afa8-8094084bcd27","Type":"ContainerDied","Data":"b00b22db35e9e59ce34982a6015bfb134074cab045b3fdf90b118105cac05149"} Jun 09 14:50:30.718764 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:30.718335 2564 scope.go:117] "RemoveContainer" containerID="2b993856464ad7363af764d9aa70516ef61b6ada2a8506d5146c5e9f82982a0d" Jun 09 14:50:30.743965 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:30.743935 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:30.747576 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:30.747554 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fxkvw"] Jun 09 14:50:31.044117 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.044015 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a30e859-f812-4554-afa8-8094084bcd27" path="/var/lib/kubelet/pods/7a30e859-f812-4554-afa8-8094084bcd27/volumes" Jun 09 14:50:31.858575 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.858538 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-2pkmt"] Jun 09 14:50:31.859155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859136 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a30e859-f812-4554-afa8-8094084bcd27" containerName="limitador" Jun 09 14:50:31.859212 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859159 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a30e859-f812-4554-afa8-8094084bcd27" containerName="limitador" Jun 09 14:50:31.859212 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859190 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e339388-df7d-4c0e-be17-1b1711e5a70d" containerName="authorino" Jun 09 14:50:31.859212 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859199 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e339388-df7d-4c0e-be17-1b1711e5a70d" containerName="authorino" Jun 09 14:50:31.859327 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859315 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a30e859-f812-4554-afa8-8094084bcd27" containerName="limitador" Jun 09 14:50:31.859360 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.859336 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e339388-df7d-4c0e-be17-1b1711e5a70d" containerName="authorino" Jun 09 14:50:31.864243 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.864222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:31.867131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.867074 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 14:50:31.867477 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.867367 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9knmg\"" Jun 09 14:50:31.869249 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.869229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2pkmt"] Jun 09 14:50:31.979131 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.979069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-data\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:31.979297 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:31.979189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmvd\" (UniqueName: \"kubernetes.io/projected/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-kube-api-access-2nmvd\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.079962 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.079927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-data\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.080164 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.079985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmvd\" (UniqueName: \"kubernetes.io/projected/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-kube-api-access-2nmvd\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.080341 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.080316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-data\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.088251 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.088220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmvd\" (UniqueName: \"kubernetes.io/projected/f1ef8ab7-fc08-4754-9b3d-532fc6f86804-kube-api-access-2nmvd\") pod \"postgres-69fb4594cf-2pkmt\" (UID: \"f1ef8ab7-fc08-4754-9b3d-532fc6f86804\") " pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.177368 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.177286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:32.313567 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.313542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2pkmt"] Jun 09 14:50:32.314161 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:50:32.314134 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ef8ab7_fc08_4754_9b3d_532fc6f86804.slice/crio-d26ffe65b1a16309b6b7e17df22022c52f07a8639496453ca939a6751b63dd48 WatchSource:0}: Error finding container d26ffe65b1a16309b6b7e17df22022c52f07a8639496453ca939a6751b63dd48: Status 404 returned error can't find the container with id d26ffe65b1a16309b6b7e17df22022c52f07a8639496453ca939a6751b63dd48 Jun 09 14:50:32.732144 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:32.732109 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2pkmt" event={"ID":"f1ef8ab7-fc08-4754-9b3d-532fc6f86804","Type":"ContainerStarted","Data":"d26ffe65b1a16309b6b7e17df22022c52f07a8639496453ca939a6751b63dd48"} Jun 09 14:50:39.782346 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:39.782307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2pkmt" event={"ID":"f1ef8ab7-fc08-4754-9b3d-532fc6f86804","Type":"ContainerStarted","Data":"f6d179b4991af997b988e01cad903d673dca3683de63a0237822a2cc587be89d"} Jun 09 14:50:39.782729 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:39.782461 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:39.800837 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:39.800782 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-2pkmt" podStartSLOduration=2.098336139 podStartE2EDuration="8.800767921s" totalImagesPullingTime="6.702431782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:39.798644927 +0000 UTC m=+821.281919665" watchObservedRunningTime="2026-06-09 14:50:39.800767921 +0000 UTC m=+821.284042658" Jun 09 14:50:45.818020 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:45.817987 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-2pkmt" Jun 09 14:50:47.438515 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.438483 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj"] Jun 09 14:50:47.443783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.443765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.446504 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.446482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 14:50:47.446627 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.446483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 14:50:47.447279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.447263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jr7d7\"" Jun 09 14:50:47.451877 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.451470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj"] Jun 09 14:50:47.522763 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.522725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.522953 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.522792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nscc4\" (UniqueName: \"kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.522953 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.522858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.623624 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.623588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.623821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.623642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nscc4\" (UniqueName: \"kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.623821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.623677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.624047 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.624024 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.624150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.624070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.640066 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.640040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nscc4\" (UniqueName: \"kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.755295 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.755210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:47.893990 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:47.893959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj"] Jun 09 14:50:47.895724 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:50:47.895694 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bbad6d_d3c7_4a8d_badb_a881c9c72cd2.slice/crio-6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6 WatchSource:0}: Error finding container 6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6: Status 404 returned error can't find the container with id 6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6 Jun 09 14:50:48.834639 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:48.834602 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerID="c86e27f9b62578a7628dc5801bbe57fdbf730de583a732f6db276b8045b57d5d" exitCode=0 Jun 09 14:50:48.835047 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:48.834679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" event={"ID":"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2","Type":"ContainerDied","Data":"c86e27f9b62578a7628dc5801bbe57fdbf730de583a732f6db276b8045b57d5d"} Jun 09 14:50:48.835047 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:48.834722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" event={"ID":"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2","Type":"ContainerStarted","Data":"6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6"} Jun 09 14:50:49.842274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:49.842186 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerID="5154cccf0a238dca6a579df7487f94250179e0e0784f488eeb7e19021a276275" exitCode=0 Jun 09 14:50:49.842274 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:49.842245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" event={"ID":"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2","Type":"ContainerDied","Data":"5154cccf0a238dca6a579df7487f94250179e0e0784f488eeb7e19021a276275"} Jun 09 14:50:50.850170 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:50.850134 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerID="ad8f2ff8e6fe69ddb9ca5ef10273084e24c882d5b8e6e2f4d09f3b5eecbb1b5c" exitCode=0 Jun 09 14:50:50.850582 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:50.850204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" event={"ID":"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2","Type":"ContainerDied","Data":"ad8f2ff8e6fe69ddb9ca5ef10273084e24c882d5b8e6e2f4d09f3b5eecbb1b5c"} Jun 09 14:50:52.081990 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.081953 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:52.162266 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.162185 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle\") pod \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " Jun 09 14:50:52.162438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.162290 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util\") pod \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " Jun 09 14:50:52.162438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.162346 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nscc4\" (UniqueName: \"kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4\") pod \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\" (UID: \"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2\") " Jun 09 14:50:52.162716 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.162691 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle" (OuterVolumeSpecName: "bundle") pod "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" (UID: "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:50:52.164602 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.164576 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4" (OuterVolumeSpecName: "kube-api-access-nscc4") pod "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" (UID: "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2"). InnerVolumeSpecName "kube-api-access-nscc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:50:52.168360 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.168336 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util" (OuterVolumeSpecName: "util") pod "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" (UID: "f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:50:52.263586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.263547 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-util\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:52.263586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.263578 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nscc4\" (UniqueName: \"kubernetes.io/projected/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-kube-api-access-nscc4\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:52.263586 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.263589 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2-bundle\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:50:52.863172 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.863129 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" event={"ID":"f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2","Type":"ContainerDied","Data":"6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6"} Jun 09 14:50:52.863337 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.863181 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748wksnj" Jun 09 14:50:52.863337 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:50:52.863189 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ec847e88b7f19fcae1926dcab5a2c2b1c9d1c8f4c46bde60e7fbb2bf92b54e6" Jun 09 14:51:13.166930 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.166897 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167346 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="pull" Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167364 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="pull" Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167385 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="util" Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167390 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="util" Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167403 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="extract" Jun 09 14:51:13.167452 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167408 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="extract" Jun 09 14:51:13.167656 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.167496 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8bbad6d-d3c7-4a8d-badb-a881c9c72cd2" containerName="extract" Jun 09 14:51:13.169423 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.169408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:13.172141 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.172123 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 14:51:13.172291 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.172123 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 14:51:13.173242 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.173228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-blfzf\"" Jun 09 14:51:13.173329 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.173261 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 14:51:13.182116 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.182071 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:51:13.255323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.255286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vkqs\" (UniqueName: \"kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs\") pod \"maas-keycloak-0\" (UID: \"a3950148-e474-4d06-a056-672fea5f3110\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:13.356150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.356116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vkqs\" (UniqueName: \"kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs\") pod \"maas-keycloak-0\" (UID: \"a3950148-e474-4d06-a056-672fea5f3110\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:13.364267 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.364238 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vkqs\" (UniqueName: \"kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs\") pod \"maas-keycloak-0\" (UID: \"a3950148-e474-4d06-a056-672fea5f3110\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:13.480392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.480296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:13.618635 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.618609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:51:13.619101 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:51:13.619062 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3950148_e474_4d06_a056_672fea5f3110.slice/crio-88d856ff3ee9eec2ce0d4a3db86ebd1db61f443708b5ae32e4878f5a2e0bbc57 WatchSource:0}: Error finding container 88d856ff3ee9eec2ce0d4a3db86ebd1db61f443708b5ae32e4878f5a2e0bbc57: Status 404 returned error can't find the container with id 88d856ff3ee9eec2ce0d4a3db86ebd1db61f443708b5ae32e4878f5a2e0bbc57 Jun 09 14:51:13.986099 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:13.986060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3950148-e474-4d06-a056-672fea5f3110","Type":"ContainerStarted","Data":"88d856ff3ee9eec2ce0d4a3db86ebd1db61f443708b5ae32e4878f5a2e0bbc57"} Jun 09 14:51:19.023988 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:19.023889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3950148-e474-4d06-a056-672fea5f3110","Type":"ContainerStarted","Data":"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806"} Jun 09 14:51:19.046542 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:19.046474 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.034215134 podStartE2EDuration="6.046454347s" totalImagesPullingTime="5.012239213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:19.043422474 +0000 UTC m=+860.526697221" watchObservedRunningTime="2026-06-09 14:51:19.046454347 +0000 UTC m=+860.529729086" Jun 09 14:51:19.481007 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:19.480963 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:19.483012 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:19.482967 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:20.481051 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:20.480996 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:21.480660 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:21.480620 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:22.481281 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:22.481228 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:23.481161 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:23.481115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:23.481631 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:23.481592 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:24.481251 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:24.481197 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:25.481020 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:25.480976 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:26.481150 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:26.481068 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:27.481127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:27.481053 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:28.480645 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:28.480606 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:29.480887 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:29.480829 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:30.480868 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:30.480822 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:31.481191 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:31.481141 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.54:9000/health/started\": dial tcp 10.132.0.54:9000: connect: connection refused" Jun 09 14:51:32.573953 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:32.573915 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:32.588360 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:32.588301 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 14:51:42.580970 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:42.580874 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 14:51:43.638459 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.638424 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nt9t7"] Jun 09 14:51:43.641279 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.641257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:43.650430 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.650401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nt9t7"] Jun 09 14:51:43.763689 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.763648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v289b\" (UniqueName: \"kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b\") pod \"authorino-5d4b67c446-nt9t7\" (UID: \"a9a0fee6-0bdd-4999-8394-cad2eed1140b\") " pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:43.834719 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.834680 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nt9t7"] Jun 09 14:51:43.834973 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:51:43.834952 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-v289b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nt9t7" podUID="a9a0fee6-0bdd-4999-8394-cad2eed1140b" Jun 09 14:51:43.862785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.862753 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:51:43.864392 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.864372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v289b\" (UniqueName: \"kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b\") pod \"authorino-5d4b67c446-nt9t7\" (UID: \"a9a0fee6-0bdd-4999-8394-cad2eed1140b\") " pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:43.865589 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.865574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:43.867794 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.867777 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 14:51:43.874655 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.874631 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:51:43.876875 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.876843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v289b\" (UniqueName: \"kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b\") pod \"authorino-5d4b67c446-nt9t7\" (UID: \"a9a0fee6-0bdd-4999-8394-cad2eed1140b\") " pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:43.965362 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.965270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:43.965362 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:43.965311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj5c8\" (UniqueName: \"kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.066406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.066371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.066406 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.066407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj5c8\" (UniqueName: \"kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.068963 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.068938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.074482 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.074455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj5c8\" (UniqueName: \"kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8\") pod \"authorino-654b9c96-fhnz4\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.175619 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.175586 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:51:44.224277 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.224188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:44.233146 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.233118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:44.314934 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.314904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:51:44.315454 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:51:44.315432 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33e7a024_a8a3_461e_a79d_43cd379d4e89.slice/crio-6da669df0d536a302a0caf24a14c5affab18647f72bab827eb4ac1e7d9455962 WatchSource:0}: Error finding container 6da669df0d536a302a0caf24a14c5affab18647f72bab827eb4ac1e7d9455962: Status 404 returned error can't find the container with id 6da669df0d536a302a0caf24a14c5affab18647f72bab827eb4ac1e7d9455962 Jun 09 14:51:44.369492 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.369461 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v289b\" (UniqueName: \"kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b\") pod \"a9a0fee6-0bdd-4999-8394-cad2eed1140b\" (UID: \"a9a0fee6-0bdd-4999-8394-cad2eed1140b\") " Jun 09 14:51:44.371616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.371593 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b" (OuterVolumeSpecName: "kube-api-access-v289b") pod "a9a0fee6-0bdd-4999-8394-cad2eed1140b" (UID: "a9a0fee6-0bdd-4999-8394-cad2eed1140b"). InnerVolumeSpecName "kube-api-access-v289b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:51:44.470205 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:44.470169 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v289b\" (UniqueName: \"kubernetes.io/projected/a9a0fee6-0bdd-4999-8394-cad2eed1140b-kube-api-access-v289b\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:51:45.231301 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.231269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654b9c96-fhnz4" event={"ID":"33e7a024-a8a3-461e-a79d-43cd379d4e89","Type":"ContainerStarted","Data":"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69"} Jun 09 14:51:45.231693 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.231314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654b9c96-fhnz4" event={"ID":"33e7a024-a8a3-461e-a79d-43cd379d4e89","Type":"ContainerStarted","Data":"6da669df0d536a302a0caf24a14c5affab18647f72bab827eb4ac1e7d9455962"} Jun 09 14:51:45.231693 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.231335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nt9t7" Jun 09 14:51:45.249169 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.249114 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-654b9c96-fhnz4" podStartSLOduration=1.9197305679999999 podStartE2EDuration="2.249080557s" totalImagesPullingTime="329.349989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:45.247814496 +0000 UTC m=+886.731089235" watchObservedRunningTime="2026-06-09 14:51:45.249080557 +0000 UTC m=+886.732355294" Jun 09 14:51:45.272683 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.272647 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nt9t7"] Jun 09 14:51:45.284640 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.284589 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:51:45.285401 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.285367 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cxklf" podUID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" containerName="authorino" containerID="cri-o://bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb" gracePeriod=30 Jun 09 14:51:45.290237 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.290207 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nt9t7"] Jun 09 14:51:45.538788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.538761 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:51:45.683125 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.683067 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bss7c\" (UniqueName: \"kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c\") pod \"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac\" (UID: \"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac\") " Jun 09 14:51:45.685360 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.685276 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c" (OuterVolumeSpecName: "kube-api-access-bss7c") pod "ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" (UID: "ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac"). InnerVolumeSpecName "kube-api-access-bss7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:51:45.784012 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:45.783979 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bss7c\" (UniqueName: \"kubernetes.io/projected/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac-kube-api-access-bss7c\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:51:46.238242 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.238208 2564 generic.go:356] "Generic (PLEG): container finished" podID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" containerID="bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb" exitCode=0 Jun 09 14:51:46.238745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.238250 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cxklf" Jun 09 14:51:46.238745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.238295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cxklf" event={"ID":"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac","Type":"ContainerDied","Data":"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb"} Jun 09 14:51:46.238745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.238345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cxklf" event={"ID":"ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac","Type":"ContainerDied","Data":"ecfa9b948b487e9c8842f62d69e0c975b5626a8d7595a3c08803faf80cfc1fd7"} Jun 09 14:51:46.238745 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.238370 2564 scope.go:117] "RemoveContainer" containerID="bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb" Jun 09 14:51:46.248276 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.248259 2564 scope.go:117] "RemoveContainer" containerID="bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb" Jun 09 14:51:46.248519 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:51:46.248502 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb\": container with ID starting with bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb not found: ID does not exist" containerID="bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb" Jun 09 14:51:46.248566 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.248526 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb"} err="failed to get container status \"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb\": rpc error: code = NotFound desc = could not find container \"bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb\": container with ID starting with bab6ed6678844a14711c76253deb48264e3afdf0338fd23c4c8f3a71f25e94bb not found: ID does not exist" Jun 09 14:51:46.260755 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.260732 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:51:46.264553 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:46.264532 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cxklf"] Jun 09 14:51:47.043917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:47.043886 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a0fee6-0bdd-4999-8394-cad2eed1140b" path="/var/lib/kubelet/pods/a9a0fee6-0bdd-4999-8394-cad2eed1140b/volumes" Jun 09 14:51:47.044166 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:47.044152 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" path="/var/lib/kubelet/pods/ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac/volumes" Jun 09 14:51:49.119589 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.119557 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:51:49.119992 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.119937 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" containerName="authorino" Jun 09 14:51:49.119992 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.119947 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" containerName="authorino" Jun 09 14:51:49.120106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.120011 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7b8d7d-6130-4fd6-abb3-c8326a11a9ac" containerName="authorino" Jun 09 14:51:49.123190 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.123171 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.126216 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.126190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 14:51:49.126589 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.126570 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6jjfh\"" Jun 09 14:51:49.127236 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.127220 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 14:51:49.146644 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.146615 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:51:49.216398 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.216359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftv6\" (UniqueName: \"kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.216573 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.216472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.317610 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.317572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.317815 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.317681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftv6\" (UniqueName: \"kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.317815 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:51:49.317720 2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 14:51:49.317815 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:51:49.317796 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert podName:f2c5e685-e5be-43f7-a57c-3c7b07751031 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:49.817780022 +0000 UTC m=+891.301054738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert") pod "maas-controller-864fd557f6-qs9t2" (UID: "f2c5e685-e5be-43f7-a57c-3c7b07751031") : secret "maas-controller-webhook-cert" not found Jun 09 14:51:49.335827 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.335795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftv6\" (UniqueName: \"kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.368556 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.368523 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:51:49.371117 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.371046 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.383715 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.383687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:51:49.519356 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.519319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.519617 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.519382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpclg\" (UniqueName: \"kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.620226 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.620188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.620391 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.620246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpclg\" (UniqueName: \"kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.622732 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.622670 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.629990 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.629966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpclg\" (UniqueName: \"kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg\") pod \"maas-controller-75874fbf88-dvmsw\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.683068 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.683033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:49.822580 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.822541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.824514 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.824429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:51:49.825328 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:49.825303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") pod \"maas-controller-864fd557f6-qs9t2\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:49.827043 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:51:49.827022 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402421c5_2708_484b_9fdb_e3aeedae25d0.slice/crio-cf272cdef6994726138d8efd121297803122280b7eb06d0c5ae06bdfa7f45059 WatchSource:0}: Error finding container cf272cdef6994726138d8efd121297803122280b7eb06d0c5ae06bdfa7f45059: Status 404 returned error can't find the container with id cf272cdef6994726138d8efd121297803122280b7eb06d0c5ae06bdfa7f45059 Jun 09 14:51:50.035809 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:50.035722 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:50.177910 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:50.177884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:51:50.263885 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:50.263852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75874fbf88-dvmsw" event={"ID":"402421c5-2708-484b-9fdb-e3aeedae25d0","Type":"ContainerStarted","Data":"cf272cdef6994726138d8efd121297803122280b7eb06d0c5ae06bdfa7f45059"} Jun 09 14:51:50.265028 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:50.265006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-qs9t2" event={"ID":"f2c5e685-e5be-43f7-a57c-3c7b07751031","Type":"ContainerStarted","Data":"9a984d04fcb646b73655719147eabb11c3d5b7b17cd74e8ba6237ba8d503ce89"} Jun 09 14:51:53.288879 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.288844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-qs9t2" event={"ID":"f2c5e685-e5be-43f7-a57c-3c7b07751031","Type":"ContainerStarted","Data":"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95"} Jun 09 14:51:53.289376 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.288943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:51:53.290503 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.290484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75874fbf88-dvmsw" event={"ID":"402421c5-2708-484b-9fdb-e3aeedae25d0","Type":"ContainerStarted","Data":"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe"} Jun 09 14:51:53.290598 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.290571 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:51:53.310904 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.310853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-864fd557f6-qs9t2" podStartSLOduration=2.048380284 podStartE2EDuration="4.310837074s" totalImagesPullingTime="2.26245679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:53.308401237 +0000 UTC m=+894.791675972" watchObservedRunningTime="2026-06-09 14:51:53.310837074 +0000 UTC m=+894.794111811" Jun 09 14:51:53.330880 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:53.330838 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75874fbf88-dvmsw" podStartSLOduration=1.721161748 podStartE2EDuration="4.330825687s" totalImagesPullingTime="2.609663939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:53.328629771 +0000 UTC m=+894.811904509" watchObservedRunningTime="2026-06-09 14:51:53.330825687 +0000 UTC m=+894.814100425" Jun 09 14:51:59.058427 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:59.058396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:51:59.059460 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:51:59.059438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:52:04.301079 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.301047 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:52:04.302407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.301241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:52:04.370387 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.370351 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:52:04.370616 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.370587 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-864fd557f6-qs9t2" podUID="f2c5e685-e5be-43f7-a57c-3c7b07751031" containerName="manager" containerID="cri-o://0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95" gracePeriod=30 Jun 09 14:52:04.619765 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.619741 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:52:04.663358 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.663329 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ftv6\" (UniqueName: \"kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6\") pod \"f2c5e685-e5be-43f7-a57c-3c7b07751031\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " Jun 09 14:52:04.663529 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.663376 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") pod \"f2c5e685-e5be-43f7-a57c-3c7b07751031\" (UID: \"f2c5e685-e5be-43f7-a57c-3c7b07751031\") " Jun 09 14:52:04.665753 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.665722 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f2c5e685-e5be-43f7-a57c-3c7b07751031" (UID: "f2c5e685-e5be-43f7-a57c-3c7b07751031"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:52:04.665869 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.665768 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6" (OuterVolumeSpecName: "kube-api-access-6ftv6") pod "f2c5e685-e5be-43f7-a57c-3c7b07751031" (UID: "f2c5e685-e5be-43f7-a57c-3c7b07751031"). InnerVolumeSpecName "kube-api-access-6ftv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:52:04.764490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.764444 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ftv6\" (UniqueName: \"kubernetes.io/projected/f2c5e685-e5be-43f7-a57c-3c7b07751031-kube-api-access-6ftv6\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:52:04.764490 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:04.764479 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2c5e685-e5be-43f7-a57c-3c7b07751031-webhook-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:52:05.360320 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.360277 2564 generic.go:356] "Generic (PLEG): container finished" podID="f2c5e685-e5be-43f7-a57c-3c7b07751031" containerID="0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95" exitCode=0 Jun 09 14:52:05.360789 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.360325 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-qs9t2" Jun 09 14:52:05.360789 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.360363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-qs9t2" event={"ID":"f2c5e685-e5be-43f7-a57c-3c7b07751031","Type":"ContainerDied","Data":"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95"} Jun 09 14:52:05.360789 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.360422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-qs9t2" event={"ID":"f2c5e685-e5be-43f7-a57c-3c7b07751031","Type":"ContainerDied","Data":"9a984d04fcb646b73655719147eabb11c3d5b7b17cd74e8ba6237ba8d503ce89"} Jun 09 14:52:05.360789 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.360450 2564 scope.go:117] "RemoveContainer" containerID="0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95" Jun 09 14:52:05.369701 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.369676 2564 scope.go:117] "RemoveContainer" containerID="0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95" Jun 09 14:52:05.369977 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:52:05.369957 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95\": container with ID starting with 0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95 not found: ID does not exist" containerID="0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95" Jun 09 14:52:05.370106 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.369986 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95"} err="failed to get container status \"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95\": rpc error: code = NotFound desc = could not find container \"0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95\": container with ID starting with 0243595b13460585ffa5bd4ce3e8e4575e8ca6a91fff65f7f97c0d0960fe4d95 not found: ID does not exist" Jun 09 14:52:05.379360 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.379336 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:52:05.383225 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:05.383205 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-864fd557f6-qs9t2"] Jun 09 14:52:07.044005 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:07.043967 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c5e685-e5be-43f7-a57c-3c7b07751031" path="/var/lib/kubelet/pods/f2c5e685-e5be-43f7-a57c-3c7b07751031/volumes" Jun 09 14:52:23.672643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.672610 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-867b78df65-d6jrh"] Jun 09 14:52:23.673215 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.673198 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c5e685-e5be-43f7-a57c-3c7b07751031" containerName="manager" Jun 09 14:52:23.673266 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.673218 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c5e685-e5be-43f7-a57c-3c7b07751031" containerName="manager" Jun 09 14:52:23.673339 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.673328 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c5e685-e5be-43f7-a57c-3c7b07751031" containerName="manager" Jun 09 14:52:23.676200 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.676182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:23.678743 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.678706 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 14:52:23.678868 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.678849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4srpg\"" Jun 09 14:52:23.685215 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.685193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-867b78df65-d6jrh"] Jun 09 14:52:23.730463 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.730433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b57lb\" (UniqueName: \"kubernetes.io/projected/35033ded-5613-423d-a903-81415972719d-kube-api-access-b57lb\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:23.730639 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.730538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:23.831892 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.831858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b57lb\" (UniqueName: \"kubernetes.io/projected/35033ded-5613-423d-a903-81415972719d-kube-api-access-b57lb\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:23.832128 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.831921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:23.832128 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:52:23.832018 2564 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 14:52:23.832128 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:52:23.832078 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls podName:35033ded-5613-423d-a903-81415972719d nodeName:}" failed. No retries permitted until 2026-06-09 14:52:24.332062169 +0000 UTC m=+925.815336889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls") pod "maas-api-867b78df65-d6jrh" (UID: "35033ded-5613-423d-a903-81415972719d") : secret "maas-api-serving-cert" not found Jun 09 14:52:23.843542 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:23.843517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b57lb\" (UniqueName: \"kubernetes.io/projected/35033ded-5613-423d-a903-81415972719d-kube-api-access-b57lb\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:24.217079 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.217048 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-nw6q9"] Jun 09 14:52:24.219885 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.219861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:24.222677 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.222657 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 14:52:24.222816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.222663 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-scf6z\"" Jun 09 14:52:24.230791 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.230767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-nw6q9"] Jun 09 14:52:24.336545 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.336514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:24.336723 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.336560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsq8c\" (UniqueName: \"kubernetes.io/projected/4ef29cd3-8818-454e-b060-00b6bc82b9ba-kube-api-access-gsq8c\") pod \"payload-pre-processing-67d7689b65-nw6q9\" (UID: \"4ef29cd3-8818-454e-b060-00b6bc82b9ba\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:24.339074 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.339044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35033ded-5613-423d-a903-81415972719d-maas-api-tls\") pod \"maas-api-867b78df65-d6jrh\" (UID: \"35033ded-5613-423d-a903-81415972719d\") " pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:24.438028 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.437980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsq8c\" (UniqueName: \"kubernetes.io/projected/4ef29cd3-8818-454e-b060-00b6bc82b9ba-kube-api-access-gsq8c\") pod \"payload-pre-processing-67d7689b65-nw6q9\" (UID: \"4ef29cd3-8818-454e-b060-00b6bc82b9ba\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:24.451210 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.451183 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsq8c\" (UniqueName: \"kubernetes.io/projected/4ef29cd3-8818-454e-b060-00b6bc82b9ba-kube-api-access-gsq8c\") pod \"payload-pre-processing-67d7689b65-nw6q9\" (UID: \"4ef29cd3-8818-454e-b060-00b6bc82b9ba\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:24.532794 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.532705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:24.590021 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.589985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:24.684642 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.684202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-nw6q9"] Jun 09 14:52:24.686139 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:52:24.686066 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef29cd3_8818_454e_b060_00b6bc82b9ba.slice/crio-1492a6f0880a07afb886b989b25839a3fdba2be592161bf11999c3a028861f47 WatchSource:0}: Error finding container 1492a6f0880a07afb886b989b25839a3fdba2be592161bf11999c3a028861f47: Status 404 returned error can't find the container with id 1492a6f0880a07afb886b989b25839a3fdba2be592161bf11999c3a028861f47 Jun 09 14:52:24.755821 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:24.755795 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-867b78df65-d6jrh"] Jun 09 14:52:24.757047 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:52:24.757021 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35033ded_5613_423d_a903_81415972719d.slice/crio-220dd8f83f5ae0821ecb3c696e42fce0009e4ff6db9bad86de579ea15ad1c49f WatchSource:0}: Error finding container 220dd8f83f5ae0821ecb3c696e42fce0009e4ff6db9bad86de579ea15ad1c49f: Status 404 returned error can't find the container with id 220dd8f83f5ae0821ecb3c696e42fce0009e4ff6db9bad86de579ea15ad1c49f Jun 09 14:52:25.480919 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:25.480867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" event={"ID":"4ef29cd3-8818-454e-b060-00b6bc82b9ba","Type":"ContainerStarted","Data":"1492a6f0880a07afb886b989b25839a3fdba2be592161bf11999c3a028861f47"} Jun 09 14:52:25.482771 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:25.482733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-867b78df65-d6jrh" event={"ID":"35033ded-5613-423d-a903-81415972719d","Type":"ContainerStarted","Data":"220dd8f83f5ae0821ecb3c696e42fce0009e4ff6db9bad86de579ea15ad1c49f"} Jun 09 14:52:27.496805 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.496764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" event={"ID":"4ef29cd3-8818-454e-b060-00b6bc82b9ba","Type":"ContainerStarted","Data":"1ff1fdba545e43d71eb758d68558e29566c6cfcc5126f7b9df8452c83e64d992"} Jun 09 14:52:27.497276 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.496836 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:27.498403 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.498370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-867b78df65-d6jrh" event={"ID":"35033ded-5613-423d-a903-81415972719d","Type":"ContainerStarted","Data":"0a317d2fe49c8654553fb221dbc322e77a204d3ffd7ce068b5d52e292b75c507"} Jun 09 14:52:27.498524 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.498466 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:27.512339 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.512301 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" podStartSLOduration=1.616653526 podStartE2EDuration="3.512289373s" totalImagesPullingTime="1.895635847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:27.510973724 +0000 UTC m=+928.994248453" watchObservedRunningTime="2026-06-09 14:52:27.512289373 +0000 UTC m=+928.995564110" Jun 09 14:52:27.526889 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:27.526833 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-867b78df65-d6jrh" podStartSLOduration=2.698846847 podStartE2EDuration="4.526816266s" totalImagesPullingTime="1.827969419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:27.52627177 +0000 UTC m=+929.009546510" watchObservedRunningTime="2026-06-09 14:52:27.526816266 +0000 UTC m=+929.010091006" Jun 09 14:52:33.509030 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:33.508997 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-867b78df65-d6jrh" Jun 09 14:52:35.468690 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:35.468648 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:35.469189 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:35.468880 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" containerID="cri-o://7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806" gracePeriod=30 Jun 09 14:52:37.519357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.519334 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:37.559661 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.559623 2564 generic.go:356] "Generic (PLEG): container finished" podID="a3950148-e474-4d06-a056-672fea5f3110" containerID="7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806" exitCode=143 Jun 09 14:52:37.559844 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.559685 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:37.559844 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.559702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3950148-e474-4d06-a056-672fea5f3110","Type":"ContainerDied","Data":"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806"} Jun 09 14:52:37.559844 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.559784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3950148-e474-4d06-a056-672fea5f3110","Type":"ContainerDied","Data":"88d856ff3ee9eec2ce0d4a3db86ebd1db61f443708b5ae32e4878f5a2e0bbc57"} Jun 09 14:52:37.559844 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.559805 2564 scope.go:117] "RemoveContainer" containerID="7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806" Jun 09 14:52:37.572565 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.572541 2564 scope.go:117] "RemoveContainer" containerID="7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806" Jun 09 14:52:37.572831 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:52:37.572811 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806\": container with ID starting with 7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806 not found: ID does not exist" containerID="7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806" Jun 09 14:52:37.572919 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.572844 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806"} err="failed to get container status \"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806\": rpc error: code = NotFound desc = could not find container \"7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806\": container with ID starting with 7dca4f4dbd30b1bc9f042edc3b0e1db2664bfc0d63df523a199fd21640a38806 not found: ID does not exist" Jun 09 14:52:37.659474 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.659380 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vkqs\" (UniqueName: \"kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs\") pod \"a3950148-e474-4d06-a056-672fea5f3110\" (UID: \"a3950148-e474-4d06-a056-672fea5f3110\") " Jun 09 14:52:37.661746 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.661722 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs" (OuterVolumeSpecName: "kube-api-access-7vkqs") pod "a3950148-e474-4d06-a056-672fea5f3110" (UID: "a3950148-e474-4d06-a056-672fea5f3110"). InnerVolumeSpecName "kube-api-access-7vkqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:52:37.760143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.760107 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vkqs\" (UniqueName: \"kubernetes.io/projected/a3950148-e474-4d06-a056-672fea5f3110-kube-api-access-7vkqs\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:52:37.882781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.882723 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:37.886042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.886020 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:37.908223 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.908194 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:37.908666 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.908651 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" Jun 09 14:52:37.908717 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.908668 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" Jun 09 14:52:37.908756 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.908746 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3950148-e474-4d06-a056-672fea5f3110" containerName="keycloak" Jun 09 14:52:37.913110 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.913056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:37.915609 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.915588 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 14:52:37.915716 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.915627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-blfzf\"" Jun 09 14:52:37.915716 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.915682 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 14:52:37.915716 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.915695 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 14:52:37.915865 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.915702 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 14:52:37.921855 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:37.921837 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:38.062724 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.062695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scx5b\" (UniqueName: \"kubernetes.io/projected/ea313561-4763-43e7-a351-bea7b7046dc4-kube-api-access-scx5b\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.062929 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.062749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ea313561-4763-43e7-a351-bea7b7046dc4-test-realms\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.163788 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.163702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ea313561-4763-43e7-a351-bea7b7046dc4-test-realms\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.163914 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.163794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scx5b\" (UniqueName: \"kubernetes.io/projected/ea313561-4763-43e7-a351-bea7b7046dc4-kube-api-access-scx5b\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.164449 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.164431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ea313561-4763-43e7-a351-bea7b7046dc4-test-realms\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.172513 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.172489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scx5b\" (UniqueName: \"kubernetes.io/projected/ea313561-4763-43e7-a351-bea7b7046dc4-kube-api-access-scx5b\") pod \"maas-keycloak-0\" (UID: \"ea313561-4763-43e7-a351-bea7b7046dc4\") " pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.224151 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.224119 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:38.360957 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.360928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 14:52:38.362253 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:52:38.362226 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea313561_4763_43e7_a351_bea7b7046dc4.slice/crio-ab0f3512819c3d83fe8301a91f5ca850ef80148cf783edf1791c92ae7ccc841b WatchSource:0}: Error finding container ab0f3512819c3d83fe8301a91f5ca850ef80148cf783edf1791c92ae7ccc841b: Status 404 returned error can't find the container with id ab0f3512819c3d83fe8301a91f5ca850ef80148cf783edf1791c92ae7ccc841b Jun 09 14:52:38.506532 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.506452 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-nw6q9" Jun 09 14:52:38.567864 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:38.567826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea313561-4763-43e7-a351-bea7b7046dc4","Type":"ContainerStarted","Data":"ab0f3512819c3d83fe8301a91f5ca850ef80148cf783edf1791c92ae7ccc841b"} Jun 09 14:52:39.045851 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:39.045817 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3950148-e474-4d06-a056-672fea5f3110" path="/var/lib/kubelet/pods/a3950148-e474-4d06-a056-672fea5f3110/volumes" Jun 09 14:52:39.577529 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:39.577491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ea313561-4763-43e7-a351-bea7b7046dc4","Type":"ContainerStarted","Data":"283fd18e4038718bf3ea0ebb8962ebcd93ee18a10e56779b973e6ce3ced1c671"} Jun 09 14:52:39.599692 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:39.599629 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.302470411 podStartE2EDuration="2.599606195s" totalImagesPullingTime="297.135784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:39.594421339 +0000 UTC m=+941.077696078" watchObservedRunningTime="2026-06-09 14:52:39.599606195 +0000 UTC m=+941.082880936" Jun 09 14:52:40.224708 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:40.224660 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:40.227059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:40.227009 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:41.225344 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:41.225297 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:42.225413 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:42.225364 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:43.225453 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:43.225401 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:44.225588 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:44.225508 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:45.225264 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:45.225214 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:46.225179 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:46.225129 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:47.224758 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:47.224719 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:48.224613 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:48.224574 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:48.225063 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:48.224900 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:49.225563 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:49.225516 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:50.225211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:50.225163 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:51.225191 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:51.225146 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.61:9000/health/started\": dial tcp 10.132.0.61:9000: connect: connection refused" Jun 09 14:52:52.353546 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:52.353497 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 14:52:52.371775 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:52:52.371697 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ea313561-4763-43e7-a351-bea7b7046dc4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 14:53:02.359766 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:02.359726 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 14:53:13.291339 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.291256 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:53:13.294833 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.294817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.297257 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.297235 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 14:53:13.302674 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.302652 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:53:13.411386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.411348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.411386 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.411384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.411630 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.411518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngq7\" (UniqueName: \"kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.512163 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.512135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngq7\" (UniqueName: \"kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.512321 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.512188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.512321 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.512215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.512839 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.512820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.514728 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.514709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.520250 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.520231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngq7\" (UniqueName: \"kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7\") pod \"authorino-67f7d48998-xlzh7\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.605244 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.605218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:53:13.742363 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.742314 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:53:13.743733 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:53:13.743708 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d59d85a_11ab_4657_b586_f7a65a4e32be.slice/crio-7f805a973ddd3fb09324fbb905c70d285b7e72749cbb5feef4de9ec0f4b77cd1 WatchSource:0}: Error finding container 7f805a973ddd3fb09324fbb905c70d285b7e72749cbb5feef4de9ec0f4b77cd1: Status 404 returned error can't find the container with id 7f805a973ddd3fb09324fbb905c70d285b7e72749cbb5feef4de9ec0f4b77cd1 Jun 09 14:53:13.818056 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:13.818019 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f7d48998-xlzh7" event={"ID":"1d59d85a-11ab-4657-b586-f7a65a4e32be","Type":"ContainerStarted","Data":"7f805a973ddd3fb09324fbb905c70d285b7e72749cbb5feef4de9ec0f4b77cd1"} Jun 09 14:53:14.827288 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:14.827243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f7d48998-xlzh7" event={"ID":"1d59d85a-11ab-4657-b586-f7a65a4e32be","Type":"ContainerStarted","Data":"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc"} Jun 09 14:53:14.845356 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:14.845301 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67f7d48998-xlzh7" podStartSLOduration=1.3703200899999999 podStartE2EDuration="1.845285935s" totalImagesPullingTime="474.965845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:53:14.844683172 +0000 UTC m=+976.327957925" watchObservedRunningTime="2026-06-09 14:53:14.845285935 +0000 UTC m=+976.328560688" Jun 09 14:53:14.878611 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:14.878576 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:53:14.878840 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:14.878789 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-654b9c96-fhnz4" podUID="33e7a024-a8a3-461e-a79d-43cd379d4e89" containerName="authorino" containerID="cri-o://de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69" gracePeriod=30 Jun 09 14:53:15.145299 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.145276 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:53:15.230201 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.230171 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert\") pod \"33e7a024-a8a3-461e-a79d-43cd379d4e89\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " Jun 09 14:53:15.230396 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.230219 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj5c8\" (UniqueName: \"kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8\") pod \"33e7a024-a8a3-461e-a79d-43cd379d4e89\" (UID: \"33e7a024-a8a3-461e-a79d-43cd379d4e89\") " Jun 09 14:53:15.232407 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.232375 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8" (OuterVolumeSpecName: "kube-api-access-qj5c8") pod "33e7a024-a8a3-461e-a79d-43cd379d4e89" (UID: "33e7a024-a8a3-461e-a79d-43cd379d4e89"). InnerVolumeSpecName "kube-api-access-qj5c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:53:15.241126 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.241097 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "33e7a024-a8a3-461e-a79d-43cd379d4e89" (UID: "33e7a024-a8a3-461e-a79d-43cd379d4e89"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:53:15.331238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.331204 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33e7a024-a8a3-461e-a79d-43cd379d4e89-tls-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:53:15.331238 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.331230 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj5c8\" (UniqueName: \"kubernetes.io/projected/33e7a024-a8a3-461e-a79d-43cd379d4e89-kube-api-access-qj5c8\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:53:15.834001 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.833906 2564 generic.go:356] "Generic (PLEG): container finished" podID="33e7a024-a8a3-461e-a79d-43cd379d4e89" containerID="de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69" exitCode=0 Jun 09 14:53:15.834001 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.833965 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654b9c96-fhnz4" Jun 09 14:53:15.834001 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.833988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654b9c96-fhnz4" event={"ID":"33e7a024-a8a3-461e-a79d-43cd379d4e89","Type":"ContainerDied","Data":"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69"} Jun 09 14:53:15.834580 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.834039 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654b9c96-fhnz4" event={"ID":"33e7a024-a8a3-461e-a79d-43cd379d4e89","Type":"ContainerDied","Data":"6da669df0d536a302a0caf24a14c5affab18647f72bab827eb4ac1e7d9455962"} Jun 09 14:53:15.834580 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.834058 2564 scope.go:117] "RemoveContainer" containerID="de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69" Jun 09 14:53:15.843899 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.843884 2564 scope.go:117] "RemoveContainer" containerID="de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69" Jun 09 14:53:15.844162 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:53:15.844142 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69\": container with ID starting with de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69 not found: ID does not exist" containerID="de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69" Jun 09 14:53:15.844239 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.844175 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69"} err="failed to get container status \"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69\": rpc error: code = NotFound desc = could not find container \"de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69\": container with ID starting with de882e637b7dea9b7358bebf77e9829c3ffd13fd1badbff024e137f4f98afa69 not found: ID does not exist" Jun 09 14:53:15.858223 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.858194 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:53:15.862101 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:15.862065 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-654b9c96-fhnz4"] Jun 09 14:53:17.044309 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:17.044275 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e7a024-a8a3-461e-a79d-43cd379d4e89" path="/var/lib/kubelet/pods/33e7a024-a8a3-461e-a79d-43cd379d4e89/volumes" Jun 09 14:53:25.458026 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.457983 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm"] Jun 09 14:53:25.458536 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.458516 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e7a024-a8a3-461e-a79d-43cd379d4e89" containerName="authorino" Jun 09 14:53:25.458600 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.458538 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e7a024-a8a3-461e-a79d-43cd379d4e89" containerName="authorino" Jun 09 14:53:25.458665 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.458624 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e7a024-a8a3-461e-a79d-43cd379d4e89" containerName="authorino" Jun 09 14:53:25.463812 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.463788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.467515 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.467492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 14:53:25.467739 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.467714 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gdgs5\"" Jun 09 14:53:25.467739 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.467735 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 14:53:25.467901 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.467715 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 14:53:25.470709 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.470687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm"] Jun 09 14:53:25.624581 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.624781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266be688-fe19-4d5e-b9d2-c756061597b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.624781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.624781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq54t\" (UniqueName: \"kubernetes.io/projected/266be688-fe19-4d5e-b9d2-c756061597b6-kube-api-access-hq54t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.624781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.624781 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.624742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725608 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq54t\" (UniqueName: \"kubernetes.io/projected/266be688-fe19-4d5e-b9d2-c756061597b6-kube-api-access-hq54t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725608 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725797 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725835 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725871 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266be688-fe19-4d5e-b9d2-c756061597b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725916 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.725953 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.725910 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.726199 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.726176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.726331 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.726238 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.728042 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.728022 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/266be688-fe19-4d5e-b9d2-c756061597b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.728376 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.728359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/266be688-fe19-4d5e-b9d2-c756061597b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.733846 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.733826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq54t\" (UniqueName: \"kubernetes.io/projected/266be688-fe19-4d5e-b9d2-c756061597b6-kube-api-access-hq54t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm\" (UID: \"266be688-fe19-4d5e-b9d2-c756061597b6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.777826 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.777797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:25.923018 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:25.922984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm"] Jun 09 14:53:25.924636 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:53:25.924607 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266be688_fe19_4d5e_b9d2_c756061597b6.slice/crio-8a68c792e3c37d07a5119a8c4ab2b31309a959ca55590fb7960be6a4521c42fd WatchSource:0}: Error finding container 8a68c792e3c37d07a5119a8c4ab2b31309a959ca55590fb7960be6a4521c42fd: Status 404 returned error can't find the container with id 8a68c792e3c37d07a5119a8c4ab2b31309a959ca55590fb7960be6a4521c42fd Jun 09 14:53:26.903393 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:26.903359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" event={"ID":"266be688-fe19-4d5e-b9d2-c756061597b6","Type":"ContainerStarted","Data":"8a68c792e3c37d07a5119a8c4ab2b31309a959ca55590fb7960be6a4521c42fd"} Jun 09 14:53:30.936208 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:30.936164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" event={"ID":"266be688-fe19-4d5e-b9d2-c756061597b6","Type":"ContainerStarted","Data":"751f736f0a7fe9de6157fb18328dec708f5ca9da38880bad2b158349a3ec2fd7"} Jun 09 14:53:31.944053 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:31.944016 2564 generic.go:356] "Generic (PLEG): container finished" podID="266be688-fe19-4d5e-b9d2-c756061597b6" containerID="751f736f0a7fe9de6157fb18328dec708f5ca9da38880bad2b158349a3ec2fd7" exitCode=0 Jun 09 14:53:31.944502 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:31.944058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" event={"ID":"266be688-fe19-4d5e-b9d2-c756061597b6","Type":"ContainerDied","Data":"751f736f0a7fe9de6157fb18328dec708f5ca9da38880bad2b158349a3ec2fd7"} Jun 09 14:53:33.959132 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:33.959073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" event={"ID":"266be688-fe19-4d5e-b9d2-c756061597b6","Type":"ContainerStarted","Data":"9f96ef11d62f9031473b4c736f27a788468c773bd297e0cf8570a4639f702fee"} Jun 09 14:53:33.981251 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:33.981199 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" podStartSLOduration=2.221531371 podStartE2EDuration="8.981185012s" totalImagesPullingTime="5.426999789s" totalInitContainerRuntime="1.332653852s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:53:33.978926221 +0000 UTC m=+995.462200981" watchObservedRunningTime="2026-06-09 14:53:33.981185012 +0000 UTC m=+995.464459763" Jun 09 14:53:35.778897 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:35.778859 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:35.779352 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:35.778924 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:35.791828 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:35.791806 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:35.982941 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:35.982900 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm" Jun 09 14:53:51.890465 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.890433 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw"] Jun 09 14:53:51.896342 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.896320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.899727 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.899706 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 14:53:51.910801 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.910757 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw"] Jun 09 14:53:51.976608 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.976816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.976816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxf42\" (UniqueName: \"kubernetes.io/projected/01648a80-3a2d-4b67-b143-26fa25bc7814-kube-api-access-mxf42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.976816 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.976999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:51.976999 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:51.976926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01648a80-3a2d-4b67-b143-26fa25bc7814-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077419 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077419 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01648a80-3a2d-4b67-b143-26fa25bc7814-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.077668 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxf42\" (UniqueName: \"kubernetes.io/projected/01648a80-3a2d-4b67-b143-26fa25bc7814-kube-api-access-mxf42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.078234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.078234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.078234 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.077983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.080225 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.080203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01648a80-3a2d-4b67-b143-26fa25bc7814-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.080328 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.080308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01648a80-3a2d-4b67-b143-26fa25bc7814-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.086127 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.086106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxf42\" (UniqueName: \"kubernetes.io/projected/01648a80-3a2d-4b67-b143-26fa25bc7814-kube-api-access-mxf42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mrsgw\" (UID: \"01648a80-3a2d-4b67-b143-26fa25bc7814\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.211911 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.211785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:53:52.352783 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:52.352751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw"] Jun 09 14:53:52.353637 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:53:52.353614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01648a80_3a2d_4b67_b143_26fa25bc7814.slice/crio-010f8162e7c9947e1bb56712f4a09ee93190a7811bff2f901d86582fec1f4406 WatchSource:0}: Error finding container 010f8162e7c9947e1bb56712f4a09ee93190a7811bff2f901d86582fec1f4406: Status 404 returned error can't find the container with id 010f8162e7c9947e1bb56712f4a09ee93190a7811bff2f901d86582fec1f4406 Jun 09 14:53:53.074643 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:53.074605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" event={"ID":"01648a80-3a2d-4b67-b143-26fa25bc7814","Type":"ContainerStarted","Data":"4eec4fc4957b425e263e3c99f13026d6ce6ff25eb81ea27bcf5a506100b630aa"} Jun 09 14:53:53.075060 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:53.074667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" event={"ID":"01648a80-3a2d-4b67-b143-26fa25bc7814","Type":"ContainerStarted","Data":"010f8162e7c9947e1bb56712f4a09ee93190a7811bff2f901d86582fec1f4406"} Jun 09 14:53:54.082420 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:54.082322 2564 generic.go:356] "Generic (PLEG): container finished" podID="01648a80-3a2d-4b67-b143-26fa25bc7814" containerID="4eec4fc4957b425e263e3c99f13026d6ce6ff25eb81ea27bcf5a506100b630aa" exitCode=0 Jun 09 14:53:54.082842 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:54.082410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" event={"ID":"01648a80-3a2d-4b67-b143-26fa25bc7814","Type":"ContainerDied","Data":"4eec4fc4957b425e263e3c99f13026d6ce6ff25eb81ea27bcf5a506100b630aa"} Jun 09 14:53:54.082947 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:54.082930 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:53:55.090522 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:55.090490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" event={"ID":"01648a80-3a2d-4b67-b143-26fa25bc7814","Type":"ContainerStarted","Data":"0a1aa6262d46b19afadb45a1a32a6f00da71ee81b6752a8cda0f42680a2b8fea"} Jun 09 14:53:55.113382 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:53:55.113330 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" podStartSLOduration=2.369911639 podStartE2EDuration="4.113314713s" totalImagesPullingTime="502.592573ms" totalInitContainerRuntime="1.240810501s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:53:55.111353088 +0000 UTC m=+1016.594627826" watchObservedRunningTime="2026-06-09 14:53:55.113314713 +0000 UTC m=+1016.596589452" Jun 09 14:54:02.211968 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:02.211933 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:54:02.212464 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:02.212022 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:54:02.225582 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:02.225553 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:54:03.146793 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:03.146768 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mrsgw" Jun 09 14:54:06.471480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.471449 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v"] Jun 09 14:54:06.476656 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.476637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.479143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.479121 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 14:54:06.483520 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.483497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v"] Jun 09 14:54:06.615931 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.615901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.616143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.615969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.616143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.616057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.616143 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.616118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.616270 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.616150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm9h8\" (UniqueName: \"kubernetes.io/projected/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kube-api-access-hm9h8\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.616270 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.616177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.716681 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.716647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.716681 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.716682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.716922 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.716700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm9h8\" (UniqueName: \"kubernetes.io/projected/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kube-api-access-hm9h8\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.716922 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.716843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.717038 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.716973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.717118 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.717063 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.717184 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.717113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.717184 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.717140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.717323 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.717304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.719110 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.719067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.719579 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.719558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.726595 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.726546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm9h8\" (UniqueName: \"kubernetes.io/projected/a0f1e0ba-1611-498f-a163-cd6a48aa5c2f-kube-api-access-hm9h8\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v\" (UID: \"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.788785 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.788757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:06.930787 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:06.930755 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v"] Jun 09 14:54:06.932148 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:54:06.932116 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f1e0ba_1611_498f_a163_cd6a48aa5c2f.slice/crio-15a507de00e46dabb61c12d6778bee4f2c381eea66b2b9efdcf44a7e913d02e2 WatchSource:0}: Error finding container 15a507de00e46dabb61c12d6778bee4f2c381eea66b2b9efdcf44a7e913d02e2: Status 404 returned error can't find the container with id 15a507de00e46dabb61c12d6778bee4f2c381eea66b2b9efdcf44a7e913d02e2 Jun 09 14:54:07.159719 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:07.159681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" event={"ID":"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f","Type":"ContainerStarted","Data":"6628cf71dc8dece2332f06ac0886826d49a99ddda55c6dacac3b858b1533616b"} Jun 09 14:54:07.159868 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:07.159738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" event={"ID":"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f","Type":"ContainerStarted","Data":"15a507de00e46dabb61c12d6778bee4f2c381eea66b2b9efdcf44a7e913d02e2"} Jun 09 14:54:09.174715 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:09.174678 2564 generic.go:356] "Generic (PLEG): container finished" podID="a0f1e0ba-1611-498f-a163-cd6a48aa5c2f" containerID="6628cf71dc8dece2332f06ac0886826d49a99ddda55c6dacac3b858b1533616b" exitCode=0 Jun 09 14:54:09.175223 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:09.174715 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" event={"ID":"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f","Type":"ContainerDied","Data":"6628cf71dc8dece2332f06ac0886826d49a99ddda55c6dacac3b858b1533616b"} Jun 09 14:54:10.182716 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:10.182683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" event={"ID":"a0f1e0ba-1611-498f-a163-cd6a48aa5c2f","Type":"ContainerStarted","Data":"f630a34c329b0891409dbb5a8824e88bd8c4adf328cc52f037cf61feb914d8db"} Jun 09 14:54:10.205693 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:10.205636 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" podStartSLOduration=2.731216823 podStartE2EDuration="4.205619764s" totalImagesPullingTime="230.443482ms" totalInitContainerRuntime="1.243959459s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:10.202488731 +0000 UTC m=+1031.685763470" watchObservedRunningTime="2026-06-09 14:54:10.205619764 +0000 UTC m=+1031.688894571" Jun 09 14:54:16.789661 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:16.789616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:16.790191 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:16.789695 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:16.802101 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:16.802059 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:17.233701 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:17.233674 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v" Jun 09 14:54:22.884343 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.884308 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5"] Jun 09 14:54:22.889155 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.889139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.892480 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.892459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 14:54:22.929037 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.929008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5"] Jun 09 14:54:22.978511 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.978657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.978657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d50796-2a6f-4426-bc3d-b57f36733e16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.978657 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.978769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4s2k\" (UniqueName: \"kubernetes.io/projected/27d50796-2a6f-4426-bc3d-b57f36733e16-kube-api-access-j4s2k\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:22.978769 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:22.978745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080235 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d50796-2a6f-4426-bc3d-b57f36733e16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080402 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4s2k\" (UniqueName: \"kubernetes.io/projected/27d50796-2a6f-4426-bc3d-b57f36733e16-kube-api-access-j4s2k\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080638 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080697 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080697 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.080790 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.080716 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.082809 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.082782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27d50796-2a6f-4426-bc3d-b57f36733e16-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.083018 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.082999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27d50796-2a6f-4426-bc3d-b57f36733e16-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.088768 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.088751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4s2k\" (UniqueName: \"kubernetes.io/projected/27d50796-2a6f-4426-bc3d-b57f36733e16-kube-api-access-j4s2k\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5\" (UID: \"27d50796-2a6f-4426-bc3d-b57f36733e16\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.199723 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.199626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:23.341438 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:23.341407 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5"] Jun 09 14:54:23.342839 ip-10-0-143-134 kubenswrapper[2564]: W0609 14:54:23.342814 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d50796_2a6f_4426_bc3d_b57f36733e16.slice/crio-a2cf97bb966e1b70c119896d76f7406bc054ff96430b51eace2ff22256d7ad06 WatchSource:0}: Error finding container a2cf97bb966e1b70c119896d76f7406bc054ff96430b51eace2ff22256d7ad06: Status 404 returned error can't find the container with id a2cf97bb966e1b70c119896d76f7406bc054ff96430b51eace2ff22256d7ad06 Jun 09 14:54:24.277009 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:24.276972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" event={"ID":"27d50796-2a6f-4426-bc3d-b57f36733e16","Type":"ContainerStarted","Data":"e3adb29c112252327e1b5af5b78e6db44928f3743fc8e9bb9a24431d0af9e238"} Jun 09 14:54:24.277473 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:24.277051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" event={"ID":"27d50796-2a6f-4426-bc3d-b57f36733e16","Type":"ContainerStarted","Data":"a2cf97bb966e1b70c119896d76f7406bc054ff96430b51eace2ff22256d7ad06"} Jun 09 14:54:32.326071 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:32.326039 2564 generic.go:356] "Generic (PLEG): container finished" podID="27d50796-2a6f-4426-bc3d-b57f36733e16" containerID="e3adb29c112252327e1b5af5b78e6db44928f3743fc8e9bb9a24431d0af9e238" exitCode=0 Jun 09 14:54:32.326441 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:32.326069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" event={"ID":"27d50796-2a6f-4426-bc3d-b57f36733e16","Type":"ContainerDied","Data":"e3adb29c112252327e1b5af5b78e6db44928f3743fc8e9bb9a24431d0af9e238"} Jun 09 14:54:34.339856 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:34.339820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" event={"ID":"27d50796-2a6f-4426-bc3d-b57f36733e16","Type":"ContainerStarted","Data":"c3bd0cc6fccba297e07514256826b94ded4b18f2816ae7cfae64c3e0c420dce4"} Jun 09 14:54:34.367547 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:34.367496 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" podStartSLOduration=2.173282346 podStartE2EDuration="12.367480303s" totalImagesPullingTime="1.316279936s" totalInitContainerRuntime="8.877918021s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:34.364590537 +0000 UTC m=+1055.847865293" watchObservedRunningTime="2026-06-09 14:54:34.367480303 +0000 UTC m=+1055.850755040" Jun 09 14:54:43.200419 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:43.200324 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:43.200419 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:43.200397 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:43.213314 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:43.213282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:54:43.406729 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:54:43.406699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5" Jun 09 14:55:50.367209 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.367175 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8584bdf787-s4hnm"] Jun 09 14:55:50.371028 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.371009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.379815 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.379791 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8584bdf787-s4hnm"] Jun 09 14:55:50.446825 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.446781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-tls-cert\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.447016 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.446885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c97s\" (UniqueName: \"kubernetes.io/projected/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-kube-api-access-5c97s\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.447016 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.446928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-oidc-ca\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.548587 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.548549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-tls-cert\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.548768 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.548622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c97s\" (UniqueName: \"kubernetes.io/projected/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-kube-api-access-5c97s\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.548768 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.548667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-oidc-ca\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.549376 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.549320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-oidc-ca\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.551210 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.551182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-tls-cert\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.557300 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.557282 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c97s\" (UniqueName: \"kubernetes.io/projected/c36c20f8-1f54-4961-bea9-4f62d0fe50c7-kube-api-access-5c97s\") pod \"authorino-8584bdf787-s4hnm\" (UID: \"c36c20f8-1f54-4961-bea9-4f62d0fe50c7\") " pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.681966 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.681873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8584bdf787-s4hnm" Jun 09 14:55:50.829301 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:50.827542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8584bdf787-s4hnm"] Jun 09 14:55:51.808917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:51.808874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8584bdf787-s4hnm" event={"ID":"c36c20f8-1f54-4961-bea9-4f62d0fe50c7","Type":"ContainerStarted","Data":"62e75491723747f57e7cad76dd0950513a2817eb0873bb9e42e76be8a3002ac4"} Jun 09 14:55:51.809333 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:51.808935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8584bdf787-s4hnm" event={"ID":"c36c20f8-1f54-4961-bea9-4f62d0fe50c7","Type":"ContainerStarted","Data":"21c3fb20d383693d093296247be4904020f91248ae9dbe492ece3e7ff7810dfa"} Jun 09 14:55:51.858211 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:51.857689 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8584bdf787-s4hnm" podStartSLOduration=1.446367744 podStartE2EDuration="1.857662069s" totalImagesPullingTime="411.294325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:55:51.829247448 +0000 UTC m=+1133.312522191" watchObservedRunningTime="2026-06-09 14:55:51.857662069 +0000 UTC m=+1133.340936807" Jun 09 14:55:51.860549 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:51.860521 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:55:51.860786 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:51.860762 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67f7d48998-xlzh7" podUID="1d59d85a-11ab-4657-b586-f7a65a4e32be" containerName="authorino" containerID="cri-o://8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc" gracePeriod=30 Jun 09 14:55:52.126648 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.126624 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:55:52.266171 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.266139 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tngq7\" (UniqueName: \"kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7\") pod \"1d59d85a-11ab-4657-b586-f7a65a4e32be\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " Jun 09 14:55:52.266355 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.266235 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca\") pod \"1d59d85a-11ab-4657-b586-f7a65a4e32be\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " Jun 09 14:55:52.266355 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.266280 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert\") pod \"1d59d85a-11ab-4657-b586-f7a65a4e32be\" (UID: \"1d59d85a-11ab-4657-b586-f7a65a4e32be\") " Jun 09 14:55:52.268912 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.268877 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7" (OuterVolumeSpecName: "kube-api-access-tngq7") pod "1d59d85a-11ab-4657-b586-f7a65a4e32be" (UID: "1d59d85a-11ab-4657-b586-f7a65a4e32be"). InnerVolumeSpecName "kube-api-access-tngq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:55:52.272462 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.272428 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "1d59d85a-11ab-4657-b586-f7a65a4e32be" (UID: "1d59d85a-11ab-4657-b586-f7a65a4e32be"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:55:52.278337 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.278310 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1d59d85a-11ab-4657-b586-f7a65a4e32be" (UID: "1d59d85a-11ab-4657-b586-f7a65a4e32be"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:55:52.368059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.367972 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tngq7\" (UniqueName: \"kubernetes.io/projected/1d59d85a-11ab-4657-b586-f7a65a4e32be-kube-api-access-tngq7\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:55:52.368059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.368006 2564 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1d59d85a-11ab-4657-b586-f7a65a4e32be-oidc-ca\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:55:52.368059 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.368017 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d59d85a-11ab-4657-b586-f7a65a4e32be-tls-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:55:52.817159 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.817064 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d59d85a-11ab-4657-b586-f7a65a4e32be" containerID="8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc" exitCode=0 Jun 09 14:55:52.817159 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.817132 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f7d48998-xlzh7" Jun 09 14:55:52.817612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.817152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f7d48998-xlzh7" event={"ID":"1d59d85a-11ab-4657-b586-f7a65a4e32be","Type":"ContainerDied","Data":"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc"} Jun 09 14:55:52.817612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.817197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f7d48998-xlzh7" event={"ID":"1d59d85a-11ab-4657-b586-f7a65a4e32be","Type":"ContainerDied","Data":"7f805a973ddd3fb09324fbb905c70d285b7e72749cbb5feef4de9ec0f4b77cd1"} Jun 09 14:55:52.817612 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.817220 2564 scope.go:117] "RemoveContainer" containerID="8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc" Jun 09 14:55:52.827674 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.827652 2564 scope.go:117] "RemoveContainer" containerID="8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc" Jun 09 14:55:52.827969 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:55:52.827950 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc\": container with ID starting with 8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc not found: ID does not exist" containerID="8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc" Jun 09 14:55:52.828048 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.827976 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc"} err="failed to get container status \"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc\": rpc error: code = NotFound desc = could not find container \"8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc\": container with ID starting with 8a6581b852f9de117022ea22d09fd782b20156fa1f2e0d5a678677c7e8f267bc not found: ID does not exist" Jun 09 14:55:52.842233 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.842195 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:55:52.845685 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:52.845666 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67f7d48998-xlzh7"] Jun 09 14:55:53.046255 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:55:53.046222 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d59d85a-11ab-4657-b586-f7a65a4e32be" path="/var/lib/kubelet/pods/1d59d85a-11ab-4657-b586-f7a65a4e32be/volumes" Jun 09 14:56:59.105868 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:56:59.105837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:56:59.108770 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:56:59.108749 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 14:57:30.931825 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:30.931788 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:57:30.934449 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:30.931986 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75874fbf88-dvmsw" podUID="402421c5-2708-484b-9fdb-e3aeedae25d0" containerName="manager" containerID="cri-o://b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe" gracePeriod=30 Jun 09 14:57:31.197357 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.197294 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:57:31.221565 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.221534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpclg\" (UniqueName: \"kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg\") pod \"402421c5-2708-484b-9fdb-e3aeedae25d0\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " Jun 09 14:57:31.221774 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.221650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert\") pod \"402421c5-2708-484b-9fdb-e3aeedae25d0\" (UID: \"402421c5-2708-484b-9fdb-e3aeedae25d0\") " Jun 09 14:57:31.223772 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.223739 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "402421c5-2708-484b-9fdb-e3aeedae25d0" (UID: "402421c5-2708-484b-9fdb-e3aeedae25d0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:57:31.223772 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.223755 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg" (OuterVolumeSpecName: "kube-api-access-gpclg") pod "402421c5-2708-484b-9fdb-e3aeedae25d0" (UID: "402421c5-2708-484b-9fdb-e3aeedae25d0"). InnerVolumeSpecName "kube-api-access-gpclg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:57:31.322631 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.322596 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpclg\" (UniqueName: \"kubernetes.io/projected/402421c5-2708-484b-9fdb-e3aeedae25d0-kube-api-access-gpclg\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:57:31.322631 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.322630 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/402421c5-2708-484b-9fdb-e3aeedae25d0-webhook-cert\") on node \"ip-10-0-143-134.ec2.internal\" DevicePath \"\"" Jun 09 14:57:31.430405 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.430368 2564 generic.go:356] "Generic (PLEG): container finished" podID="402421c5-2708-484b-9fdb-e3aeedae25d0" containerID="b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe" exitCode=0 Jun 09 14:57:31.430561 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.430417 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75874fbf88-dvmsw" Jun 09 14:57:31.430561 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.430456 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75874fbf88-dvmsw" event={"ID":"402421c5-2708-484b-9fdb-e3aeedae25d0","Type":"ContainerDied","Data":"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe"} Jun 09 14:57:31.430561 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.430514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75874fbf88-dvmsw" event={"ID":"402421c5-2708-484b-9fdb-e3aeedae25d0","Type":"ContainerDied","Data":"cf272cdef6994726138d8efd121297803122280b7eb06d0c5ae06bdfa7f45059"} Jun 09 14:57:31.430561 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.430540 2564 scope.go:117] "RemoveContainer" containerID="b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe" Jun 09 14:57:31.440917 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.440896 2564 scope.go:117] "RemoveContainer" containerID="b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe" Jun 09 14:57:31.441219 ip-10-0-143-134 kubenswrapper[2564]: E0609 14:57:31.441198 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe\": container with ID starting with b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe not found: ID does not exist" containerID="b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe" Jun 09 14:57:31.441313 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.441225 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe"} err="failed to get container status \"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe\": rpc error: code = NotFound desc = could not find container \"b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe\": container with ID starting with b222c6ee9f3972530046b9dc4654f7215cfa61ec170293ee1042a0ff68662ebe not found: ID does not exist" Jun 09 14:57:31.454416 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.454338 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:57:31.458025 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:31.457999 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75874fbf88-dvmsw"] Jun 09 14:57:33.044787 ip-10-0-143-134 kubenswrapper[2564]: I0609 14:57:33.044753 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402421c5-2708-484b-9fdb-e3aeedae25d0" path="/var/lib/kubelet/pods/402421c5-2708-484b-9fdb-e3aeedae25d0/volumes" Jun 09 15:01:59.154608 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:01:59.154578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 15:01:59.156899 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:01:59.156870 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 15:04:54.007526 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:04:54.007495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8584bdf787-s4hnm_c36c20f8-1f54-4961-bea9-4f62d0fe50c7/authorino/0.log" Jun 09 15:04:59.218658 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:04:59.218624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-867b78df65-d6jrh_35033ded-5613-423d-a903-81415972719d/maas-api/0.log" Jun 09 15:05:00.075322 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.075290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-zr7bd_1540582a-1299-42e5-8ade-752931e3c8dc/manager/0.log" Jun 09 15:05:00.081204 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.081183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-zr7bd_1540582a-1299-42e5-8ade-752931e3c8dc/copy-manifests/0.log" Jun 09 15:05:00.191449 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.191409 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2pkmt_f1ef8ab7-fc08-4754-9b3d-532fc6f86804/postgres/0.log" Jun 09 15:05:00.979776 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.979745 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/util/0.log" Jun 09 15:05:00.985417 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.985397 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/pull/0.log" Jun 09 15:05:00.992757 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:00.992741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/extract/0.log" Jun 09 15:05:01.109300 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.109270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/util/0.log" Jun 09 15:05:01.115583 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.115558 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/pull/0.log" Jun 09 15:05:01.121468 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.121443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/extract/0.log" Jun 09 15:05:01.248816 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.248737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/util/0.log" Jun 09 15:05:01.254469 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.254450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/pull/0.log" Jun 09 15:05:01.260288 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.260270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/extract/0.log" Jun 09 15:05:01.370751 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.370724 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/util/0.log" Jun 09 15:05:01.376521 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.376469 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/pull/0.log" Jun 09 15:05:01.381777 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.381757 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/extract/0.log" Jun 09 15:05:01.499911 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.499826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8584bdf787-s4hnm_c36c20f8-1f54-4961-bea9-4f62d0fe50c7/authorino/0.log" Jun 09 15:05:01.856555 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:01.856534 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-v2pwl_e5a75eef-e42e-4138-880a-8f2735f58fbb/kuadrant-console-plugin/0.log" Jun 09 15:05:03.061443 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:03.061416 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-m7wbd_1806b7e0-5f5d-4c5b-bd73-fc87bf908be2/kube-auth-proxy/0.log" Jun 09 15:05:03.310490 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:03.310446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-nw6q9_4ef29cd3-8818-454e-b060-00b6bc82b9ba/payload-pre-processing/0.log" Jun 09 15:05:03.927721 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:03.927692 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm_266be688-fe19-4d5e-b9d2-c756061597b6/storage-initializer/0.log" Jun 09 15:05:03.934639 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:03.934616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ldqlm_266be688-fe19-4d5e-b9d2-c756061597b6/main/0.log" Jun 09 15:05:04.053958 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.053927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mrsgw_01648a80-3a2d-4b67-b143-26fa25bc7814/storage-initializer/0.log" Jun 09 15:05:04.060527 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.060502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mrsgw_01648a80-3a2d-4b67-b143-26fa25bc7814/main/0.log" Jun 09 15:05:04.184335 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.184261 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v_a0f1e0ba-1611-498f-a163-cd6a48aa5c2f/storage-initializer/0.log" Jun 09 15:05:04.190323 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.190304 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tlr4v_a0f1e0ba-1611-498f-a163-cd6a48aa5c2f/main/0.log" Jun 09 15:05:04.456621 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.456545 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5_27d50796-2a6f-4426-bc3d-b57f36733e16/storage-initializer/0.log" Jun 09 15:05:04.463212 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:04.463192 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9nzt5_27d50796-2a6f-4426-bc3d-b57f36733e16/main/0.log" Jun 09 15:05:12.508559 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:12.508473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-znl82_0177362c-e8a9-47c0-a195-4a1b53401fc8/global-pull-secret-syncer/0.log" Jun 09 15:05:12.609545 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:12.609514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-spdt2_2cf5c8ec-8f16-4b80-9012-c2f211db2b98/konnectivity-agent/0.log" Jun 09 15:05:12.652547 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:12.652513 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-134.ec2.internal_f940acdef2a382196cf29d0889dfafe1/haproxy/0.log" Jun 09 15:05:17.677555 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.677512 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/extract/0.log" Jun 09 15:05:17.707187 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.707163 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/util/0.log" Jun 09 15:05:17.731759 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.731734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5hqj_59654a99-80a5-4143-9259-c1aa54166a65/pull/0.log" Jun 09 15:05:17.764498 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.764468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/extract/0.log" Jun 09 15:05:17.787832 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.787810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/util/0.log" Jun 09 15:05:17.812476 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.812454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0khhbt_342c8a3a-2a03-4b11-b655-1041b9c867ac/pull/0.log" Jun 09 15:05:17.849624 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.849600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/extract/0.log" Jun 09 15:05:17.874894 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.874871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/util/0.log" Jun 09 15:05:17.896467 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.896440 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qdmgl_7783b628-482b-4a93-b28c-d82daad7ffcf/pull/0.log" Jun 09 15:05:17.924164 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.924131 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/extract/0.log" Jun 09 15:05:17.944778 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.944715 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/util/0.log" Jun 09 15:05:17.964627 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:17.964603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dz646_d4d91d0a-0a8d-4477-90f0-12bfc48c1f94/pull/0.log" Jun 09 15:05:18.046522 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:18.046488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8584bdf787-s4hnm_c36c20f8-1f54-4961-bea9-4f62d0fe50c7/authorino/0.log" Jun 09 15:05:18.149008 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:18.148980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-v2pwl_e5a75eef-e42e-4138-880a-8f2735f58fbb/kuadrant-console-plugin/0.log" Jun 09 15:05:20.244521 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.244448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/alertmanager/0.log" Jun 09 15:05:20.271714 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.271690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/config-reloader/0.log" Jun 09 15:05:20.295961 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.295921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/kube-rbac-proxy-web/0.log" Jun 09 15:05:20.320415 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.320391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/kube-rbac-proxy/0.log" Jun 09 15:05:20.341878 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.341856 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/kube-rbac-proxy-metric/0.log" Jun 09 15:05:20.366207 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.366182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/prom-label-proxy/0.log" Jun 09 15:05:20.391373 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.391350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f33ae7ac-7981-4424-8455-ebb378c8a936/init-config-reloader/0.log" Jun 09 15:05:20.432269 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.432241 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-hwbpf_2c13f034-0ed2-411b-8d07-b6b365f65ad2/cluster-monitoring-operator/0.log" Jun 09 15:05:20.460477 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.460451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vjt2f_720aa010-43e2-41ea-858c-e68c72ed09d0/kube-state-metrics/0.log" Jun 09 15:05:20.480926 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.480903 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vjt2f_720aa010-43e2-41ea-858c-e68c72ed09d0/kube-rbac-proxy-main/0.log" Jun 09 15:05:20.501368 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.501291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-vjt2f_720aa010-43e2-41ea-858c-e68c72ed09d0/kube-rbac-proxy-self/0.log" Jun 09 15:05:20.529005 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.528981 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7745b9f7-554s5_b22fbccf-8456-4d53-b242-df45a8b454d2/metrics-server/0.log" Jun 09 15:05:20.682381 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.682355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js2xt_d02fa7f5-1f00-44c4-aa84-cc1028c470f2/node-exporter/0.log" Jun 09 15:05:20.703481 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.703454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js2xt_d02fa7f5-1f00-44c4-aa84-cc1028c470f2/kube-rbac-proxy/0.log" Jun 09 15:05:20.725018 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.724993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-js2xt_d02fa7f5-1f00-44c4-aa84-cc1028c470f2/init-textfile/0.log" Jun 09 15:05:20.834885 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.834811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sz5pl_06063208-30c8-41fb-9058-97ae11515552/kube-rbac-proxy-main/0.log" Jun 09 15:05:20.856589 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.856567 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sz5pl_06063208-30c8-41fb-9058-97ae11515552/kube-rbac-proxy-self/0.log" Jun 09 15:05:20.880721 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:20.880697 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sz5pl_06063208-30c8-41fb-9058-97ae11515552/openshift-state-metrics/0.log" Jun 09 15:05:21.199683 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:21.199641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64cffb84bd-hnrtg_c6031114-cbf2-4b23-8cf6-5ea83f28afc2/telemeter-client/0.log" Jun 09 15:05:21.225185 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:21.225162 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64cffb84bd-hnrtg_c6031114-cbf2-4b23-8cf6-5ea83f28afc2/reload/0.log" Jun 09 15:05:21.246141 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:21.246114 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-64cffb84bd-hnrtg_c6031114-cbf2-4b23-8cf6-5ea83f28afc2/kube-rbac-proxy/0.log" Jun 09 15:05:22.593211 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:22.593179 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-rmrb2_918ed93e-33d5-4b54-b715-01e49cf6e2bf/networking-console-plugin/0.log" Jun 09 15:05:23.245544 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.245502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/2.log" Jun 09 15:05:23.249589 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.249565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-h59n4_b2db5a4b-aca6-49b2-82d9-a51ed82657e0/console-operator/3.log" Jun 09 15:05:23.740693 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.740661 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6"] Jun 09 15:05:23.741134 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741120 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402421c5-2708-484b-9fdb-e3aeedae25d0" containerName="manager" Jun 09 15:05:23.741196 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741135 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="402421c5-2708-484b-9fdb-e3aeedae25d0" containerName="manager" Jun 09 15:05:23.741196 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741155 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d59d85a-11ab-4657-b586-f7a65a4e32be" containerName="authorino" Jun 09 15:05:23.741196 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741163 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d59d85a-11ab-4657-b586-f7a65a4e32be" containerName="authorino" Jun 09 15:05:23.741297 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741286 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d59d85a-11ab-4657-b586-f7a65a4e32be" containerName="authorino" Jun 09 15:05:23.741335 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.741301 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="402421c5-2708-484b-9fdb-e3aeedae25d0" containerName="manager" Jun 09 15:05:23.744836 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.744821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.747204 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.747180 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2cjhm\"/\"kube-root-ca.crt\"" Jun 09 15:05:23.748115 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.748075 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2cjhm\"/\"openshift-service-ca.crt\"" Jun 09 15:05:23.748115 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.748075 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2cjhm\"/\"default-dockercfg-nb799\"" Jun 09 15:05:23.753658 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.753636 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6"] Jun 09 15:05:23.867464 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.867426 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-757754c85d-r28m8_e86725b9-3496-4d01-a259-34b942421cc2/console/0.log" Jun 09 15:05:23.883735 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.883707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-proc\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.883865 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.883754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9n9s\" (UniqueName: \"kubernetes.io/projected/894d54b3-410f-44e7-944f-639b553e7509-kube-api-access-x9n9s\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.883865 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.883814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-podres\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.883865 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.883841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-sys\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.883970 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.883891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-lib-modules\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984599 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9n9s\" (UniqueName: \"kubernetes.io/projected/894d54b3-410f-44e7-944f-639b553e7509-kube-api-access-x9n9s\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984599 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-podres\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984823 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-sys\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984823 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-lib-modules\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984823 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-podres\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984823 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-proc\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984823 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-sys\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984992 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-proc\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.984992 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.984870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/894d54b3-410f-44e7-944f-639b553e7509-lib-modules\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:23.993022 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:23.992955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9n9s\" (UniqueName: \"kubernetes.io/projected/894d54b3-410f-44e7-944f-639b553e7509-kube-api-access-x9n9s\") pod \"perf-node-gather-daemonset-x4pq6\" (UID: \"894d54b3-410f-44e7-944f-639b553e7509\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:24.056603 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:24.056566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:24.197673 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:24.197643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6"] Jun 09 15:05:24.198609 ip-10-0-143-134 kubenswrapper[2564]: W0609 15:05:24.198581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod894d54b3_410f_44e7_944f_639b553e7509.slice/crio-e14723bd074023a6be985e0c5c391635dd4a54e0314aceac2e88529f7f288e00 WatchSource:0}: Error finding container e14723bd074023a6be985e0c5c391635dd4a54e0314aceac2e88529f7f288e00: Status 404 returned error can't find the container with id e14723bd074023a6be985e0c5c391635dd4a54e0314aceac2e88529f7f288e00 Jun 09 15:05:24.295353 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:24.295315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" event={"ID":"894d54b3-410f-44e7-944f-639b553e7509","Type":"ContainerStarted","Data":"e14723bd074023a6be985e0c5c391635dd4a54e0314aceac2e88529f7f288e00"} Jun 09 15:05:24.614783 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:24.614756 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-n94xp_64a92861-a7e1-4446-bbea-121a194da0e8/volume-data-source-validator/0.log" Jun 09 15:05:25.303172 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.303135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" event={"ID":"894d54b3-410f-44e7-944f-639b553e7509","Type":"ContainerStarted","Data":"3e4bd3c8f12fbca370b978d3701635dfa8047a4364c182c1fffdfd89c10af98d"} Jun 09 15:05:25.303658 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.303311 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:25.329543 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.329499 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" podStartSLOduration=2.32948544 podStartE2EDuration="2.32948544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:25.327559731 +0000 UTC m=+1706.810834470" watchObservedRunningTime="2026-06-09 15:05:25.32948544 +0000 UTC m=+1706.812760182" Jun 09 15:05:25.754762 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.754729 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26dn6_89bf9679-28fb-427f-84c0-4b38f59e6126/dns/0.log" Jun 09 15:05:25.777335 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.777313 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26dn6_89bf9679-28fb-427f-84c0-4b38f59e6126/kube-rbac-proxy/0.log" Jun 09 15:05:25.988728 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:25.988699 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nsvdz_49567040-a90c-43a8-9cef-44956944a72a/dns-node-resolver/0.log" Jun 09 15:05:26.617483 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:26.617453 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv9dk_18a5aaeb-a11e-4c31-882e-fd0fdb42de16/node-ca/0.log" Jun 09 15:05:27.726909 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:27.726877 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-m7wbd_1806b7e0-5f5d-4c5b-bd73-fc87bf908be2/kube-auth-proxy/0.log" Jun 09 15:05:27.822152 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:27.822121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-nw6q9_4ef29cd3-8818-454e-b060-00b6bc82b9ba/payload-pre-processing/0.log" Jun 09 15:05:28.612490 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:28.612465 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2bkw_741376eb-5d5f-48b1-9cd6-40ff6587e737/serve-healthcheck-canary/0.log" Jun 09 15:05:29.140935 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:29.140896 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dgkpj_83bcf2c9-5f45-4659-97d3-9aa3b30804cb/insights-operator/1.log" Jun 09 15:05:29.141363 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:29.141043 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dgkpj_83bcf2c9-5f45-4659-97d3-9aa3b30804cb/insights-operator/0.log" Jun 09 15:05:29.374923 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:29.374897 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzq89_f0347449-9991-4187-8119-ab35a8618604/kube-rbac-proxy/0.log" Jun 09 15:05:29.398430 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:29.398355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzq89_f0347449-9991-4187-8119-ab35a8618604/exporter/0.log" Jun 09 15:05:29.418414 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:29.418383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vzq89_f0347449-9991-4187-8119-ab35a8618604/extractor/0.log" Jun 09 15:05:31.319786 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:31.319747 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-x4pq6" Jun 09 15:05:31.779637 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:31.779613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-867b78df65-d6jrh_35033ded-5613-423d-a903-81415972719d/maas-api/0.log" Jun 09 15:05:32.099355 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:32.099337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-zr7bd_1540582a-1299-42e5-8ade-752931e3c8dc/manager/0.log" Jun 09 15:05:32.120345 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:32.120317 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-zr7bd_1540582a-1299-42e5-8ade-752931e3c8dc/copy-manifests/0.log" Jun 09 15:05:32.145391 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:32.145365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2pkmt_f1ef8ab7-fc08-4754-9b3d-532fc6f86804/postgres/0.log" Jun 09 15:05:34.014074 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:34.014047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6fc4b59877-r6fbg_46decef0-af09-4ea9-9509-9e3174daf082/manager/0.log" Jun 09 15:05:37.661049 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:37.661020 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-m7wbd_1806b7e0-5f5d-4c5b-bd73-fc87bf908be2/kube-auth-proxy/0.log" Jun 09 15:05:37.721029 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:37.720995 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-nw6q9_4ef29cd3-8818-454e-b060-00b6bc82b9ba/payload-pre-processing/0.log" Jun 09 15:05:38.917560 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:38.917534 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-m7wbd_1806b7e0-5f5d-4c5b-bd73-fc87bf908be2/kube-auth-proxy/0.log" Jun 09 15:05:38.981683 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:38.981652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-nw6q9_4ef29cd3-8818-454e-b060-00b6bc82b9ba/payload-pre-processing/0.log" Jun 09 15:05:39.282197 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:39.282121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-dpfhg_4e1c3ad1-61ab-4d48-a805-fdb323e4716d/migrator/0.log" Jun 09 15:05:39.301982 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:39.301958 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-dpfhg_4e1c3ad1-61ab-4d48-a805-fdb323e4716d/graceful-termination/0.log" Jun 09 15:05:39.774353 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:39.774316 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kpsrs_2dee6e07-33ad-4a5d-b643-654c0e20e9bd/kube-storage-version-migrator-operator/1.log" Jun 09 15:05:39.775293 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:39.775272 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kpsrs_2dee6e07-33ad-4a5d-b643-654c0e20e9bd/kube-storage-version-migrator-operator/0.log" Jun 09 15:05:40.753947 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:40.753919 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-m7wbd_1806b7e0-5f5d-4c5b-bd73-fc87bf908be2/kube-auth-proxy/0.log" Jun 09 15:05:40.818932 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:40.818903 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-nw6q9_4ef29cd3-8818-454e-b060-00b6bc82b9ba/payload-pre-processing/0.log" Jun 09 15:05:40.978879 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:40.978843 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-55qlb_a354512e-ca37-40df-a6ea-33f8b1930c59/kube-multus/0.log" Jun 09 15:05:41.001664 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.001634 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/kube-multus-additional-cni-plugins/0.log" Jun 09 15:05:41.025740 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.025653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/egress-router-binary-copy/0.log" Jun 09 15:05:41.045221 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.045196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/cni-plugins/0.log" Jun 09 15:05:41.064743 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.064709 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/bond-cni-plugin/0.log" Jun 09 15:05:41.085547 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.085514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/routeoverride-cni/0.log" Jun 09 15:05:41.108637 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.108617 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/whereabouts-cni-bincopy/0.log" Jun 09 15:05:41.130481 ip-10-0-143-134 kubenswrapper[2564]: I0609 15:05:41.130458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-86wdz_1ae5f1f5-2dd1-48e0-951d-e2affc416875/whereabouts-cni/0.log"