Jul 07 13:25:32.743774 ip-10-0-138-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 13:25:32.743789 ip-10-0-138-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 13:25:32.743799 ip-10-0-138-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 13:25:32.744095 ip-10-0-138-57 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 13:25:42.760347 ip-10-0-138-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 13:25:42.760367 ip-10-0-138-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c1ffac14fc8540ad8f1ac73105d0ccc1 -- Jul 07 13:27:38.118744 ip-10-0-138-57 systemd[1]: Starting Kubernetes Kubelet... Jul 07 13:27:38.540155 ip-10-0-138-57 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:27:38.540155 ip-10-0-138-57 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 13:27:38.540155 ip-10-0-138-57 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:27:38.540155 ip-10-0-138-57 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 13:27:38.540155 ip-10-0-138-57 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 13:27:38.541845 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.541764 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 13:27:38.549018 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.548995 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.549018 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549014 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.549018 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549018 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.549018 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549021 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.549018 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549026 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549029 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549033 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549036 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549039 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549042 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549045 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549047 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549050 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549053 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549056 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549058 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549061 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549063 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549066 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549069 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549072 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549075 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549077 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549080 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.549224 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549082 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549085 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549087 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549090 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549092 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549094 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549100 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549102 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549105 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549108 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549112 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549115 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549118 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549121 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549125 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549129 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549132 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549135 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549138 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.549751 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549140 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549143 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549145 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549148 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549150 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549153 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549156 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549158 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549161 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549163 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549166 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549168 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549171 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549174 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549178 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549180 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549183 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549185 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549188 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549190 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.550230 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549193 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549195 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549198 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549200 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549203 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549207 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549209 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549213 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549215 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549218 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549220 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549223 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549226 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549228 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549231 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549234 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549236 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549239 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549241 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.550761 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549244 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549247 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549249 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549252 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549254 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549257 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549259 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549262 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549264 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549267 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549269 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549272 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549274 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549277 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549280 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549282 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549285 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549990 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549996 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.549999 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.551252 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550003 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550007 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550009 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550012 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550015 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550017 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550020 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550023 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550025 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550028 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550031 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550034 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550037 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550039 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550042 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550045 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550048 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550051 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550053 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550055 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.551776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550058 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550061 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550065 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550069 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550072 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550074 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550077 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550079 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550082 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550086 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550089 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550093 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550096 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550100 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550102 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550105 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550107 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550110 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550113 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.552315 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550116 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550118 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550121 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550124 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550126 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550129 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550131 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550134 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550138 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550142 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550144 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550147 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550150 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550152 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550155 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550158 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550160 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550162 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550165 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.552827 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550167 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550169 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550172 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550174 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550177 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550179 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550182 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550185 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550188 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550190 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550193 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550195 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550198 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550200 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550202 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550205 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550207 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550210 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550213 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550216 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.553318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550218 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550221 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550224 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550226 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550228 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550231 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550233 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550236 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550239 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550241 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550244 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550246 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550249 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550251 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550254 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550256 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550259 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550261 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550648 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550653 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.553871 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550656 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550659 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550662 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550664 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550667 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550670 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550673 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550675 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550678 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550680 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550683 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550685 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550688 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550690 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550693 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550696 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550698 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550700 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550703 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.554409 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550706 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550708 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550710 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550714 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550718 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550720 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550723 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550725 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550728 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550731 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550733 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550739 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550742 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550744 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550747 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550749 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550751 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550754 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550756 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.554909 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550760 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550762 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550765 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550767 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550770 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550773 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550775 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550778 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550780 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550783 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550786 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550788 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550791 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550795 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550797 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550800 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550802 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550805 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550807 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550810 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.555523 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550813 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550817 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550820 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550823 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550827 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550833 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550836 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550839 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550842 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550844 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550847 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550850 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550852 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550854 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550857 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550859 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550862 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550866 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.556084 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550869 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550872 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550875 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550878 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550881 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550883 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550887 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550890 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550892 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550895 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550898 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550900 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550903 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550906 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550908 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550910 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550913 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550917 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550920 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.550922 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.550993 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 13:27:38.556593 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551000 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551006 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551010 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551014 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551017 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551021 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551026 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551029 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551032 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551035 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551038 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551042 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551044 2565 flags.go:64] FLAG: --cgroup-root="" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551048 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551051 2565 flags.go:64] FLAG: --client-ca-file="" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551054 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551057 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551066 2565 flags.go:64] FLAG: --cluster-domain="" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551069 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551072 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551075 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551078 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551082 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 13:27:38.557171 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551085 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551088 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551091 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551094 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551097 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551101 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551104 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551107 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551111 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551114 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551117 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551120 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551123 2565 flags.go:64] FLAG: --enable-server="true" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551125 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551130 2565 flags.go:64] FLAG: --event-burst="100" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551133 2565 flags.go:64] FLAG: --event-qps="50" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551136 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551139 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551141 2565 flags.go:64] FLAG: --eviction-hard="" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551145 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551147 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551150 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551153 2565 flags.go:64] FLAG: --eviction-soft="" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551156 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551159 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 13:27:38.557859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551162 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551166 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551169 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551172 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551174 2565 flags.go:64] FLAG: --feature-gates="" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551178 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551181 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551184 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551187 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551189 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551193 2565 flags.go:64] FLAG: --help="false" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551195 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551200 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551202 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551205 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551208 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551211 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551214 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551217 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551219 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551222 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551225 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551228 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551231 2565 flags.go:64] FLAG: --kube-reserved="" Jul 07 13:27:38.558984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551233 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551236 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551239 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551241 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551244 2565 flags.go:64] FLAG: --lock-file="" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551246 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551249 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551252 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551257 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551262 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551265 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551268 2565 flags.go:64] FLAG: --logging-format="text" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551271 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551274 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551277 2565 flags.go:64] FLAG: --manifest-url="" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551280 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551284 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551286 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551290 2565 flags.go:64] FLAG: --max-pods="110" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551293 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551297 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551299 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551302 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551305 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551308 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 13:27:38.560050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551311 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551317 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551320 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551323 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551326 2565 flags.go:64] FLAG: --pod-cidr="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551345 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551352 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551355 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551358 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551361 2565 flags.go:64] FLAG: --port="10250" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551364 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551367 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01b4f6eedf9e7b541" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551370 2565 flags.go:64] FLAG: --qos-reserved="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551373 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551376 2565 flags.go:64] FLAG: --register-node="true" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551379 2565 flags.go:64] FLAG: --register-with-taints="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551383 2565 flags.go:64] FLAG: --registry-burst="10" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551387 2565 flags.go:64] FLAG: --registry-qps="5" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551389 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551392 2565 flags.go:64] FLAG: --reserved-memory="" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551395 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551398 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551401 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551404 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551407 2565 flags.go:64] FLAG: --runonce="false" Jul 07 13:27:38.560788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551409 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551412 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551415 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551418 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551421 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551424 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551427 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551429 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551432 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551435 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551438 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551440 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551443 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551446 2565 flags.go:64] FLAG: --system-cgroups="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551448 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551454 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551456 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551459 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551464 2565 flags.go:64] FLAG: --tls-min-version="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551466 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551469 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551471 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551474 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551478 2565 flags.go:64] FLAG: --v="2" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551498 2565 flags.go:64] FLAG: --version="false" Jul 07 13:27:38.561892 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551504 2565 flags.go:64] FLAG: --vmodule="" Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551508 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.551511 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551652 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551656 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551659 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551662 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551665 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551668 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551670 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551673 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551675 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551678 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551680 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551683 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551685 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551688 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551691 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551693 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551696 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.562988 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551698 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551701 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551703 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551705 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551708 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551710 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551713 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551715 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551718 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551721 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551724 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551727 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551729 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551735 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551737 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551740 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551742 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551744 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551747 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551749 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.563884 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551752 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551754 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551758 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551762 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551765 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551767 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551770 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551773 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551776 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551778 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551781 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551784 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551787 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551790 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551792 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551795 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551797 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551800 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551802 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.564566 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551804 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551807 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551811 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551815 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551817 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551820 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551824 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551828 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551831 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551834 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551843 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551847 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551849 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551852 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551855 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551857 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551860 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551862 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551866 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.565180 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551869 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551872 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551874 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551877 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551879 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551882 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551884 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551887 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551889 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551893 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551895 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551898 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551901 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551903 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551905 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551909 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551913 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551916 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551918 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551921 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.565736 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551923 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551926 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551929 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.551931 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.552580 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.560105 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.560122 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.560845 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.560858 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.560970 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.560980 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.560987 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.560993 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.560999 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.566307 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561004 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561008 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561013 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561017 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561022 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561026 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561030 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561037 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561042 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561047 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561052 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561057 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561062 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561066 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561070 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561075 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561079 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561083 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561087 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.566701 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561093 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561097 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561102 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561106 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561110 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561115 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561120 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561124 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561129 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561133 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561137 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561141 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561146 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561150 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561154 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561158 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561162 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561166 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561170 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561174 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.567244 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561178 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561182 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561187 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561191 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561195 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561199 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561204 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561208 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561212 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561216 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561220 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561224 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561228 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561233 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561238 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561242 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561247 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561252 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561256 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561260 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.567794 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561264 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561268 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561272 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561277 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561281 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561285 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561289 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561293 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561298 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561302 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561306 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561309 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561313 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561317 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561322 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561326 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561330 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561334 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561339 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.568344 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561343 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561347 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561351 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561355 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561359 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561363 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561368 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561375 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561381 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561386 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561390 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561395 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561399 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561402 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561407 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.569093 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561411 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.561419 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561614 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561623 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561627 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561632 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561637 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561641 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561646 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561650 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561655 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561659 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561663 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561668 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561672 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 13:27:38.569778 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561676 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561680 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561684 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561688 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561693 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561697 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561702 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561706 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561710 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561714 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561719 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561723 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561727 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561732 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561736 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561740 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561744 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561748 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561753 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561757 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 13:27:38.570465 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561761 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561765 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561769 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561773 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561777 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561781 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561785 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561790 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561794 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561798 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561802 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561806 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561810 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561814 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561818 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561822 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561827 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561831 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561837 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 13:27:38.571351 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561843 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561848 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561853 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561858 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561863 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561868 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561873 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561877 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561881 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561885 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561889 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561893 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561897 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561900 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561904 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561908 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561912 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561915 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561920 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561924 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 13:27:38.572172 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561928 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561932 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561937 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561941 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561945 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561949 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561953 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561958 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561962 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561966 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561970 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561974 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561980 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561985 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561990 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.561995 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562000 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562005 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562009 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562013 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 13:27:38.572739 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562017 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562021 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562025 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562029 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562033 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562038 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:38.562044 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.562053 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.562202 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.564681 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.566086 2565 server.go:1019] "Starting client certificate rotation" Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.566191 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.566261 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 13:27:38.573243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.569125 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:27:38.573613 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.572185 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 13:27:38.581976 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.581958 2565 log.go:25] "Validated CRI v1 runtime API" Jul 07 13:27:38.584985 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.584968 2565 log.go:25] "Validated CRI v1 image API" Jul 07 13:27:38.585740 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.585710 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 13:27:38.588201 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.588180 2565 fs.go:135] Filesystem UUIDs: map[1907eefa-db04-428c-9549-3ca83cecf9a2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f34c5e0f-d900-4ed5-94a1-67206f48be5a:/dev/nvme0n1p4] Jul 07 13:27:38.588294 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.588200 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 13:27:38.592968 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.592852 2565 manager.go:216] Machine: {Timestamp:2026-07-07 13:27:38.591772245 +0000 UTC m=+0.346182484 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100720 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e0341681f4a24ec848a3cb65faa2 SystemUUID:ec26e034-1681-f4a2-4ec8-48a3cb65faa2 BootID:c1ffac14-fc85-40ad-8f1a-c73105d0ccc1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:20:96:39:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:20:96:39:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:75:05:92:64:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 13:27:38.592968 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.592955 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 13:27:38.593135 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.593054 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 13:27:38.596278 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.596252 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 13:27:38.596453 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.596281 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 13:27:38.597135 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.597118 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:27:38.597655 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.597643 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 13:27:38.597713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.597662 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 13:27:38.597713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.597672 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:27:38.598445 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.598433 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 13:27:38.599616 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.599604 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 13:27:38.602811 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.602797 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:27:38.602937 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.602926 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 13:27:38.602992 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.602964 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 07 13:27:38.602992 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.602985 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 13:27:38.603088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.603000 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 13:27:38.603088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.603013 2565 kubelet.go:398] "Adding apiserver pod source" Jul 07 13:27:38.603088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.603026 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 13:27:38.603393 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.603380 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:27:38.603461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.603404 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 13:27:38.605709 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.605694 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 13:27:38.607705 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.607693 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 13:27:38.607748 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.607723 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 13:27:38.609316 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609306 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 13:27:38.609357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609323 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 13:27:38.609357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609330 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 13:27:38.609357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609337 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 13:27:38.609357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609348 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 13:27:38.609357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609355 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609364 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609371 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609378 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609385 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609398 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 13:27:38.609632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.609404 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 13:27:38.610096 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.610085 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 13:27:38.610096 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.610097 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 13:27:38.613964 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.613940 2565 server.go:1268] "Started kubelet" Jul 07 13:27:38.614055 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.614008 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 13:27:38.614291 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.614248 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 13:27:38.614395 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.614319 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 13:27:38.614958 ip-10-0-138-57 systemd[1]: Started Kubernetes Kubelet. Jul 07 13:27:38.615719 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.615702 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 13:27:38.615904 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.615800 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 13:27:38.616002 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.615980 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 13:27:38.616130 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.616107 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 13:27:38.616294 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.616283 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 07 13:27:38.620623 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.620607 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 13:27:38.622611 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.621673 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-57.ec2.internal.18c004eab926dc26 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-57.ec2.internal,UID:ip-10-0-138-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-57.ec2.internal,},FirstTimestamp:2026-07-07 13:27:38.61390647 +0000 UTC m=+0.368316709,LastTimestamp:2026-07-07 13:27:38.61390647 +0000 UTC m=+0.368316709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-57.ec2.internal,}" Jul 07 13:27:38.623552 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.623534 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 13:27:38.623552 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.623548 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 13:27:38.623682 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.623621 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:38.624099 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624081 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 13:27:38.624099 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624079 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 13:27:38.624099 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624102 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 13:27:38.624276 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624177 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 07 13:27:38.624276 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624186 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 07 13:27:38.624410 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624395 2565 factory.go:55] Registering systemd factory Jul 07 13:27:38.624500 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624432 2565 factory.go:223] Registration of the systemd container factory successfully Jul 07 13:27:38.624659 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624648 2565 factory.go:153] Registering CRI-O factory Jul 07 13:27:38.624713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624663 2565 factory.go:223] Registration of the crio container factory successfully Jul 07 13:27:38.624713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624710 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 13:27:38.624819 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624733 2565 factory.go:103] Registering Raw factory Jul 07 13:27:38.624819 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.624748 2565 manager.go:1196] Started watching for new ooms in manager Jul 07 13:27:38.625856 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.625839 2565 manager.go:349] Starting recovery of all containers Jul 07 13:27:38.631119 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.630958 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 13:27:38.631205 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.631169 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 13:27:38.636560 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.636546 2565 manager.go:354] Recovery completed Jul 07 13:27:38.637871 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.637847 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 13:27:38.641038 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.641024 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.642922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.642907 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.642974 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.642936 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.642974 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.642949 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.643413 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.643399 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 13:27:38.643413 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.643411 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 13:27:38.643617 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.643421 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.643617 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.643429 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 07 13:27:38.644462 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644445 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.644554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644479 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.644618 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644561 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.644618 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644570 2565 policy_none.go:49] "None policy: Start" Jul 07 13:27:38.644618 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644586 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 13:27:38.644618 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.644600 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 13:27:38.645051 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.644992 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-57.ec2.internal.18c004eabae19e79 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-57.ec2.internal,UID:ip-10-0-138-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-57.ec2.internal,},FirstTimestamp:2026-07-07 13:27:38.642923129 +0000 UTC m=+0.397333371,LastTimestamp:2026-07-07 13:27:38.642923129 +0000 UTC m=+0.397333371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-57.ec2.internal,}" Jul 07 13:27:38.645651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.645638 2565 policy_none.go:47] "Start" Jul 07 13:27:38.653467 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.653405 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-57.ec2.internal.18c004eabae1e343 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-57.ec2.internal,UID:ip-10-0-138-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-57.ec2.internal,},FirstTimestamp:2026-07-07 13:27:38.642940739 +0000 UTC m=+0.397350978,LastTimestamp:2026-07-07 13:27:38.642940739 +0000 UTC m=+0.397350978,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-57.ec2.internal,}" Jul 07 13:27:38.663991 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.663973 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4prfp" Jul 07 13:27:38.664450 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.664393 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-57.ec2.internal.18c004eabae21247 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-57.ec2.internal,UID:ip-10-0-138-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-57.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-57.ec2.internal,},FirstTimestamp:2026-07-07 13:27:38.642952775 +0000 UTC m=+0.397363014,LastTimestamp:2026-07-07 13:27:38.642952775 +0000 UTC m=+0.397363014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-57.ec2.internal,}" Jul 07 13:27:38.672618 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.672601 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4prfp" Jul 07 13:27:38.672879 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.672825 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-57.ec2.internal.18c004eabae19e79\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-57.ec2.internal.18c004eabae19e79 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-57.ec2.internal,UID:ip-10-0-138-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-57.ec2.internal,},FirstTimestamp:2026-07-07 13:27:38.642923129 +0000 UTC m=+0.397333371,LastTimestamp:2026-07-07 13:27:38.644462785 +0000 UTC m=+0.398873028,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-57.ec2.internal,}" Jul 07 13:27:38.679008 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.678995 2565 manager.go:337] "Starting Device Plugin manager" Jul 07 13:27:38.679068 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.679022 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 13:27:38.679068 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679031 2565 server.go:87] "Starting device plugin registration server" Jul 07 13:27:38.679257 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679242 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 13:27:38.679381 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679257 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 13:27:38.679381 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679328 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 13:27:38.679556 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679405 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 13:27:38.679556 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.679414 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 13:27:38.679961 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.679939 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 13:27:38.680025 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.679996 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:38.780407 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.780385 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.782390 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.781356 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.782390 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.781383 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.782390 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.781399 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.782390 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.781434 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.788609 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.788592 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.788701 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.788612 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-57.ec2.internal\": node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:38.789466 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.789448 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 13:27:38.790797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.790755 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 13:27:38.790797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.790794 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 13:27:38.790943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.790815 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 13:27:38.790943 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.790851 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 13:27:38.793156 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.793141 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:38.822589 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.822570 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:38.891320 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.891295 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal"] Jul 07 13:27:38.891412 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.891369 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.892277 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.892250 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.892359 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.892283 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.892359 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.892297 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.894578 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.894566 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.894680 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.894666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.894726 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.894693 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.897562 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897546 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.897562 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897556 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.897687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897576 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.897687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897590 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.897687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897578 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.897687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.897664 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.899798 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.899784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.899851 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.899817 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 13:27:38.900430 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.900416 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientMemory" Jul 07 13:27:38.900551 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.900444 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 13:27:38.900551 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.900457 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeHasSufficientPID" Jul 07 13:27:38.914005 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.913980 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-57.ec2.internal\" not found" node="ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.917191 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.917175 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-57.ec2.internal\" not found" node="ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.922900 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:38.922887 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:38.926370 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.926356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9386b51d35694e977222ff73c9ef8b76-config\") pod \"kube-apiserver-proxy-ip-10-0-138-57.ec2.internal\" (UID: \"9386b51d35694e977222ff73c9ef8b76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.926431 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.926377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:38.926431 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:38.926395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.023835 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.023790 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:39.027050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9386b51d35694e977222ff73c9ef8b76-config\") pod \"kube-apiserver-proxy-ip-10-0-138-57.ec2.internal\" (UID: \"9386b51d35694e977222ff73c9ef8b76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.027132 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.027132 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.027286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9386b51d35694e977222ff73c9ef8b76-config\") pod \"kube-apiserver-proxy-ip-10-0-138-57.ec2.internal\" (UID: \"9386b51d35694e977222ff73c9ef8b76\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.027286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.027286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.027266 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf520380696161bcb2a0b72df4da4cb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal\" (UID: \"cf520380696161bcb2a0b72df4da4cb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.124533 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.124447 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:39.216347 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.216318 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.219953 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.219936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.224643 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.224620 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:39.327851 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.327809 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:39.428351 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.428291 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-57.ec2.internal\" not found" Jul 07 13:27:39.525578 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.525554 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:39.567315 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.567271 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 13:27:39.567964 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.567451 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:27:39.567964 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.567507 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 13:27:39.603994 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.603966 2565 apiserver.go:52] "Watching apiserver" Jul 07 13:27:39.623643 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.623618 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 13:27:39.623807 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.623790 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.625828 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.625813 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 13:27:39.627389 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.627369 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-r62wz","openshift-multus/multus-hcdvs","openshift-network-diagnostics/network-check-target-28spb","openshift-network-operator/iptables-alerter-8vd7z","kube-system/global-pull-secret-syncer-mnlfx","kube-system/konnectivity-agent-c85hd","openshift-cluster-node-tuning-operator/tuned-zh6n5","openshift-multus/multus-additional-cni-plugins-m2xqj","openshift-multus/network-metrics-daemon-dtfwr","openshift-ovn-kubernetes/ovnkube-node-wqlzl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf","openshift-dns/node-resolver-l8tn2"] Jul 07 13:27:39.630116 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.630092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.632299 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.632279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.632783 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.632764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p67xp\"" Jul 07 13:27:39.632923 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.632904 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.632987 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.632972 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.634651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.634633 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.635209 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.635191 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 13:27:39.635314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.635199 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.635314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.635211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84fpw\"" Jul 07 13:27:39.635402 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.635351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.636561 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.636535 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 13:27:39.636901 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.636888 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.637465 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.637451 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.637543 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.637528 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 13:27:39.637667 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.637650 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.637732 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.637712 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-42sgz\"" Jul 07 13:27:39.639073 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:39.639145 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.639118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:39.639256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639242 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 13:27:39.639584 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639569 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.639767 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.639846 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-72wt6\"" Jul 07 13:27:39.639846 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.639818 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 13:27:39.641348 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.641332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.642979 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.642961 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:27:39.643052 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.643039 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" Jul 07 13:27:39.643620 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.643601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.643696 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.643658 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:39.644023 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.644007 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.644179 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.644157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.644179 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.644179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2jwt\"" Jul 07 13:27:39.644403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.644388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 13:27:39.645894 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.645879 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.648393 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.648374 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 13:27:39.648476 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.648402 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 13:27:39.648539 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.648468 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xxlr6\"" Jul 07 13:27:39.648925 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.648911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.651886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.651726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.651886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.651823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 13:27:39.652049 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.651882 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:39.652511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.652449 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 13:27:39.652613 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.652591 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6ld8h\"" Jul 07 13:27:39.652755 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.652714 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 13:27:39.655755 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.655736 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.658219 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658202 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal"] Jul 07 13:27:39.658305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658230 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal"] Jul 07 13:27:39.658305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.658770 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 13:27:39.658875 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658792 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 13:27:39.658875 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.658875 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658810 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 13:27:39.658875 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658862 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qlnhp\"" Jul 07 13:27:39.659053 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.658870 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 13:27:39.659053 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.659033 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.661039 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.661020 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 13:27:39.661210 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.661193 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 13:27:39.661311 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.661296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltq29\"" Jul 07 13:27:39.666722 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.666707 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7w2x4" Jul 07 13:27:39.676080 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.676031 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:22:38 +0000 UTC" deadline="2027-12-13 04:47:19.101305721 +0000 UTC" Jul 07 13:27:39.676080 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.676068 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12567h19m39.425240279s" Jul 07 13:27:39.676080 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.676071 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7w2x4" Jul 07 13:27:39.725931 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.725914 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 13:27:39.730214 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-dbus\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.730305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-host-slash\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.730305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.730425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhlf\" (UniqueName: \"kubernetes.io/projected/c57cfa93-b25e-4051-a47f-16fa2bda3402-kube-api-access-kzhlf\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.730425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-iptables-alerter-script\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.730425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-host\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.730611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730435 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxmf\" (UniqueName: \"kubernetes.io/projected/6289db9e-4eca-4874-a0ba-8ba369f7cb63-kube-api-access-mtxmf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.730611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757215f6-580c-449d-b44e-1cdff953865d-host\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.730611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.730611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-cni-binary-copy\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.730611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-hostroot\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.730773 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-conf-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.730773 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvgk\" (UniqueName: \"kubernetes.io/projected/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-kube-api-access-bgvgk\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.730773 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-conf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.730773 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-lib-modules\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.730950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757215f6-580c-449d-b44e-1cdff953865d-serviceca\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.730950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-system-cni-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.730950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-netns\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.730950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.730950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.730976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-kubelet\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-systemd-units\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-socket-dir-parent\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-kubelet\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27a02876-7c8c-424f-a54d-b438c5e9b4fd-tmp-dir\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-netd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-env-overrides\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-system-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731309 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-cnibin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-kubernetes\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7j5t\" (UniqueName: \"kubernetes.io/projected/757215f6-580c-449d-b44e-1cdff953865d-kube-api-access-q7j5t\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-socket-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-device-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-config\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-multus-certs\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-sys-fs\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysconfig\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-sys\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j764\" (UniqueName: \"kubernetes.io/projected/ddaa8868-5ebe-483d-bd25-99a8aac38344-kube-api-access-2j764\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxdr\" (UniqueName: \"kubernetes.io/projected/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-kube-api-access-tlxdr\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-k8s-cni-cncf-io\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-bin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.731849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-etc-kubernetes\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-kubelet-config\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f87d17c-bc28-457c-8f92-0a922c782a8f-konnectivity-ca\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.731978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-tuned\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-slash\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-node-log\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-multus\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8rww\" (UniqueName: \"kubernetes.io/projected/27a02876-7c8c-424f-a54d-b438c5e9b4fd-kube-api-access-w8rww\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-var-lib-kubelet\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-systemd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-var-lib-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.732672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-daemon-config\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27a02876-7c8c-424f-a54d-b438c5e9b4fd-hosts-file\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-run\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cnibin\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-bin\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-os-release\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvhb\" (UniqueName: \"kubernetes.io/projected/78159fbf-06df-4dcb-b054-e094dc6c5096-kube-api-access-2bvhb\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-modprobe-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-tmp\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-netns\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-os-release\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.732976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-etc-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-script-lib\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-systemd\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.733369 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhfzk\" (UniqueName: \"kubernetes.io/projected/67ba0686-d17c-44ec-ae0a-07569fcad808-kube-api-access-zhfzk\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.733911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.733911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-ovn\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-log-socket\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.733911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f87d17c-bc28-457c-8f92-0a922c782a8f-agent-certs\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.733911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.733245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-registration-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.833686 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-systemd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-var-lib-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-systemd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833781 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-var-lib-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.833844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-daemon-config\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27a02876-7c8c-424f-a54d-b438c5e9b4fd-hosts-file\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.833901 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-run\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cnibin\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.833979 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27a02876-7c8c-424f-a54d-b438c5e9b4fd-hosts-file\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.833996 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:40.333952817 +0000 UTC m=+2.088363048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cnibin\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-bin\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-run\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-os-release\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-bin\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834075 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.834140 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvhb\" (UniqueName: \"kubernetes.io/projected/78159fbf-06df-4dcb-b054-e094dc6c5096-kube-api-access-2bvhb\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-os-release\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-modprobe-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-tmp\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-netns\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-os-release\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-etc-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-modprobe-d\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-netns\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-script-lib\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-etc-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-systemd\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-os-release\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhfzk\" (UniqueName: \"kubernetes.io/projected/67ba0686-d17c-44ec-ae0a-07569fcad808-kube-api-access-zhfzk\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-systemd\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-ovn\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-daemon-config\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.835147 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-log-socket\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f87d17c-bc28-457c-8f92-0a922c782a8f-agent-certs\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-ovn\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-log-socket\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-registration-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834628 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-dbus\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-registration-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-host-slash\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhlf\" (UniqueName: \"kubernetes.io/projected/c57cfa93-b25e-4051-a47f-16fa2bda3402-kube-api-access-kzhlf\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834776 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-dbus\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-iptables-alerter-script\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-host\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxmf\" (UniqueName: \"kubernetes.io/projected/6289db9e-4eca-4874-a0ba-8ba369f7cb63-kube-api-access-mtxmf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-host-slash\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757215f6-580c-449d-b44e-1cdff953865d-host\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.836075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-cni-binary-copy\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-hostroot\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.834981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-conf-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvgk\" (UniqueName: \"kubernetes.io/projected/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-kube-api-access-bgvgk\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-conf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-lib-modules\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757215f6-580c-449d-b44e-1cdff953865d-serviceca\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-script-lib\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-system-cni-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-netns\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-run-netns\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysctl-conf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-system-cni-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.837107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-kubelet\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-systemd-units\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-socket-dir-parent\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-kubelet\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835563 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-lib-modules\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27a02876-7c8c-424f-a54d-b438c5e9b4fd-tmp-dir\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-netd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-env-overrides\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835693 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-hostroot\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-system-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-cnibin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-kubernetes\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/757215f6-580c-449d-b44e-1cdff953865d-serviceca\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-conf-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.835973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-systemd-units\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7j5t\" (UniqueName: \"kubernetes.io/projected/757215f6-580c-449d-b44e-1cdff953865d-kube-api-access-q7j5t\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.838202 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-kubelet\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-socket-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-env-overrides\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78159fbf-06df-4dcb-b054-e094dc6c5096-cni-binary-copy\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-device-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-multus-socket-dir-parent\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-kubernetes\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-config\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-multus-certs\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-system-cni-dir\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-socket-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836408 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27a02876-7c8c-424f-a54d-b438c5e9b4fd-tmp-dir\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-cnibin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-sys-fs\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysconfig\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-sys\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.838895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j764\" (UniqueName: \"kubernetes.io/projected/ddaa8868-5ebe-483d-bd25-99a8aac38344-kube-api-access-2j764\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxdr\" (UniqueName: \"kubernetes.io/projected/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-kube-api-access-tlxdr\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-k8s-cni-cncf-io\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovnkube-config\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836777 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/757215f6-580c-449d-b44e-1cdff953865d-host\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-host\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-sys\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.836852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-iptables-alerter-script\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-kubelet\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-device-dir\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-run-openvswitch\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-bin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-etc-kubernetes\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-multus-certs\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837238 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-sys-fs\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-run-k8s-cni-cncf-io\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.839511 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-cni-netd\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-kubelet-config\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-sysconfig\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-etc-kubernetes\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-bin\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837419 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccdf5162-4439-4058-90bb-89d7bd1d390d-kubelet-config\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f87d17c-bc28-457c-8f92-0a922c782a8f-konnectivity-ca\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-tuned\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67ba0686-d17c-44ec-ae0a-07569fcad808-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-slash\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.837826 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.837887 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:27:40.337868947 +0000 UTC m=+2.092279190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-node-log\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-host-slash\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.837976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-multus\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c57cfa93-b25e-4051-a47f-16fa2bda3402-node-log\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78159fbf-06df-4dcb-b054-e094dc6c5096-host-var-lib-cni-multus\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8rww\" (UniqueName: \"kubernetes.io/projected/27a02876-7c8c-424f-a54d-b438c5e9b4fd-kube-api-access-w8rww\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-var-lib-kubelet\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838224 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6289db9e-4eca-4874-a0ba-8ba369f7cb63-var-lib-kubelet\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-tmp\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838421 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c57cfa93-b25e-4051-a47f-16fa2bda3402-ovn-node-metrics-cert\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f87d17c-bc28-457c-8f92-0a922c782a8f-agent-certs\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.838803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f87d17c-bc28-457c-8f92-0a922c782a8f-konnectivity-ca\") pod \"konnectivity-agent-c85hd\" (UID: \"6f87d17c-bc28-457c-8f92-0a922c782a8f\") " pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:39.840731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.840039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6289db9e-4eca-4874-a0ba-8ba369f7cb63-etc-tuned\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.851136 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.851108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxdr\" (UniqueName: \"kubernetes.io/projected/6686a05e-3fc1-4fc7-9412-2f3c9d6bb537-kube-api-access-tlxdr\") pod \"multus-additional-cni-plugins-m2xqj\" (UID: \"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537\") " pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:39.851255 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.851165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j764\" (UniqueName: \"kubernetes.io/projected/ddaa8868-5ebe-483d-bd25-99a8aac38344-kube-api-access-2j764\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:39.851400 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.850879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7j5t\" (UniqueName: \"kubernetes.io/projected/757215f6-580c-449d-b44e-1cdff953865d-kube-api-access-q7j5t\") pod \"node-ca-r62wz\" (UID: \"757215f6-580c-449d-b44e-1cdff953865d\") " pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:39.851511 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.851490 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:39.851511 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.851512 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:39.851735 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.851526 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:39.851735 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:39.851627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:40.351608818 +0000 UTC m=+2.106019060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:39.852379 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.852358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvgk\" (UniqueName: \"kubernetes.io/projected/5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc-kube-api-access-bgvgk\") pod \"iptables-alerter-8vd7z\" (UID: \"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc\") " pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:39.852507 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.852392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhlf\" (UniqueName: \"kubernetes.io/projected/c57cfa93-b25e-4051-a47f-16fa2bda3402-kube-api-access-kzhlf\") pod \"ovnkube-node-wqlzl\" (UID: \"c57cfa93-b25e-4051-a47f-16fa2bda3402\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:39.852723 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.852701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhfzk\" (UniqueName: \"kubernetes.io/projected/67ba0686-d17c-44ec-ae0a-07569fcad808-kube-api-access-zhfzk\") pod \"aws-ebs-csi-driver-node-qrlkf\" (UID: \"67ba0686-d17c-44ec-ae0a-07569fcad808\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.853739 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.853717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxmf\" (UniqueName: \"kubernetes.io/projected/6289db9e-4eca-4874-a0ba-8ba369f7cb63-kube-api-access-mtxmf\") pod \"tuned-zh6n5\" (UID: \"6289db9e-4eca-4874-a0ba-8ba369f7cb63\") " pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.854000 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.853984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvhb\" (UniqueName: \"kubernetes.io/projected/78159fbf-06df-4dcb-b054-e094dc6c5096-kube-api-access-2bvhb\") pod \"multus-hcdvs\" (UID: \"78159fbf-06df-4dcb-b054-e094dc6c5096\") " pod="openshift-multus/multus-hcdvs" Jul 07 13:27:39.854049 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.854023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8rww\" (UniqueName: \"kubernetes.io/projected/27a02876-7c8c-424f-a54d-b438c5e9b4fd-kube-api-access-w8rww\") pod \"node-resolver-l8tn2\" (UID: \"27a02876-7c8c-424f-a54d-b438c5e9b4fd\") " pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:39.866322 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:39.866287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9386b51d35694e977222ff73c9ef8b76.slice/crio-38d6bb562f0aeae43aebb5b549f40ee7f2259855361924d851ee411b20ce2c63 WatchSource:0}: Error finding container 38d6bb562f0aeae43aebb5b549f40ee7f2259855361924d851ee411b20ce2c63: Status 404 returned error can't find the container with id 38d6bb562f0aeae43aebb5b549f40ee7f2259855361924d851ee411b20ce2c63 Jul 07 13:27:39.869836 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.869818 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:27:39.965545 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.965466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" Jul 07 13:27:39.975308 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:39.975285 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6289db9e_4eca_4874_a0ba_8ba369f7cb63.slice/crio-88a3a605268bac7e186e34fe1c4d3954a60f10e28a4ecbd263a8bd0041ce0890 WatchSource:0}: Error finding container 88a3a605268bac7e186e34fe1c4d3954a60f10e28a4ecbd263a8bd0041ce0890: Status 404 returned error can't find the container with id 88a3a605268bac7e186e34fe1c4d3954a60f10e28a4ecbd263a8bd0041ce0890 Jul 07 13:27:39.984017 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.983998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" Jul 07 13:27:39.992064 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:39.992048 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:39.993024 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:39.993001 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ba0686_d17c_44ec_ae0a_07569fcad808.slice/crio-7b742239a95d1a582f91792fea1e876cd1193b0719db910d72bc6de3e92c095f WatchSource:0}: Error finding container 7b742239a95d1a582f91792fea1e876cd1193b0719db910d72bc6de3e92c095f: Status 404 returned error can't find the container with id 7b742239a95d1a582f91792fea1e876cd1193b0719db910d72bc6de3e92c095f Jul 07 13:27:40.005481 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.005461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r62wz" Jul 07 13:27:40.014887 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.014857 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757215f6_580c_449d_b44e_1cdff953865d.slice/crio-aeba3724ac33271b28b1dbf466170c247b0a43e156b8cf9cf81993076511c17d WatchSource:0}: Error finding container aeba3724ac33271b28b1dbf466170c247b0a43e156b8cf9cf81993076511c17d: Status 404 returned error can't find the container with id aeba3724ac33271b28b1dbf466170c247b0a43e156b8cf9cf81993076511c17d Jul 07 13:27:40.020673 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.020652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcdvs" Jul 07 13:27:40.027776 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.027756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8vd7z" Jul 07 13:27:40.028976 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.028948 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78159fbf_06df_4dcb_b054_e094dc6c5096.slice/crio-5697d6d1970815525989508e5c2d257582c5a1e6eff165514b1cc4559bf2ea9c WatchSource:0}: Error finding container 5697d6d1970815525989508e5c2d257582c5a1e6eff165514b1cc4559bf2ea9c: Status 404 returned error can't find the container with id 5697d6d1970815525989508e5c2d257582c5a1e6eff165514b1cc4559bf2ea9c Jul 07 13:27:40.034312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.034294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:27:40.035650 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.035630 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:40.036364 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.036335 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf6fc2_b7ed_470e_94d5_5e8d0e1a49fc.slice/crio-d205691ceeffcd6b9711ec9204edae42c9283d3fb0166090c41209e9310c1a5e WatchSource:0}: Error finding container d205691ceeffcd6b9711ec9204edae42c9283d3fb0166090c41209e9310c1a5e: Status 404 returned error can't find the container with id d205691ceeffcd6b9711ec9204edae42c9283d3fb0166090c41209e9310c1a5e Jul 07 13:27:40.042986 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.042966 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f87d17c_bc28_457c_8f92_0a922c782a8f.slice/crio-96070361093db00b67cce7a237676901d2892739c9247e5a717487a69c6285be WatchSource:0}: Error finding container 96070361093db00b67cce7a237676901d2892739c9247e5a717487a69c6285be: Status 404 returned error can't find the container with id 96070361093db00b67cce7a237676901d2892739c9247e5a717487a69c6285be Jul 07 13:27:40.063778 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.063752 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" Jul 07 13:27:40.073022 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.073001 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6686a05e_3fc1_4fc7_9412_2f3c9d6bb537.slice/crio-6bf683c8d3731715a705e46dbed08e79146d608747924459e4cc9562cf75c147 WatchSource:0}: Error finding container 6bf683c8d3731715a705e46dbed08e79146d608747924459e4cc9562cf75c147: Status 404 returned error can't find the container with id 6bf683c8d3731715a705e46dbed08e79146d608747924459e4cc9562cf75c147 Jul 07 13:27:40.080676 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.080657 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:27:40.085729 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.085710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8tn2" Jul 07 13:27:40.088845 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.088826 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57cfa93_b25e_4051_a47f_16fa2bda3402.slice/crio-dc30e91d415328fd7b7de7e2ad72b2633a2f7ba8d4e03662cc43f5c725bf19c7 WatchSource:0}: Error finding container dc30e91d415328fd7b7de7e2ad72b2633a2f7ba8d4e03662cc43f5c725bf19c7: Status 404 returned error can't find the container with id dc30e91d415328fd7b7de7e2ad72b2633a2f7ba8d4e03662cc43f5c725bf19c7 Jul 07 13:27:40.094918 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:27:40.094894 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a02876_7c8c_424f_a54d_b438c5e9b4fd.slice/crio-5a3fa92335c7ccdfac4094bf3d1c5166d47b839e3c50e95ddf087f4b1db4c514 WatchSource:0}: Error finding container 5a3fa92335c7ccdfac4094bf3d1c5166d47b839e3c50e95ddf087f4b1db4c514: Status 404 returned error can't find the container with id 5a3fa92335c7ccdfac4094bf3d1c5166d47b839e3c50e95ddf087f4b1db4c514 Jul 07 13:27:40.340950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.340852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:40.340950 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.340898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:40.341213 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.340974 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:40.341213 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.341004 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:40.341213 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.341033 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:27:41.341018403 +0000 UTC m=+3.095428634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:40.341213 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.341057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:41.341040247 +0000 UTC m=+3.095450501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:40.441949 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.441909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:40.442109 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.442086 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:40.442109 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.442108 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:40.442242 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.442122 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:40.442242 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.442183 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:41.442164889 +0000 UTC m=+3.196575134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:40.680228 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.680117 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:22:39 +0000 UTC" deadline="2028-04-15 03:51:57.476249184 +0000 UTC" Jul 07 13:27:40.680228 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.680184 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15542h24m16.796068838s" Jul 07 13:27:40.792035 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.791997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:40.792231 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.792207 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:40.792829 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.792805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:40.792959 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:40.792929 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:40.813352 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.813289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcdvs" event={"ID":"78159fbf-06df-4dcb-b054-e094dc6c5096","Type":"ContainerStarted","Data":"5697d6d1970815525989508e5c2d257582c5a1e6eff165514b1cc4559bf2ea9c"} Jul 07 13:27:40.820316 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.820277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r62wz" event={"ID":"757215f6-580c-449d-b44e-1cdff953865d","Type":"ContainerStarted","Data":"aeba3724ac33271b28b1dbf466170c247b0a43e156b8cf9cf81993076511c17d"} Jul 07 13:27:40.835113 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.835075 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" event={"ID":"6289db9e-4eca-4874-a0ba-8ba369f7cb63","Type":"ContainerStarted","Data":"88a3a605268bac7e186e34fe1c4d3954a60f10e28a4ecbd263a8bd0041ce0890"} Jul 07 13:27:40.857855 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.857819 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" event={"ID":"cf520380696161bcb2a0b72df4da4cb4","Type":"ContainerStarted","Data":"6590ef644660ed4aa725065fe35976176decf0e840b49f4a1bcfb112d56e7f72"} Jul 07 13:27:40.870315 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.870287 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:40.871649 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.871616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerStarted","Data":"6bf683c8d3731715a705e46dbed08e79146d608747924459e4cc9562cf75c147"} Jul 07 13:27:40.886258 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.886225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c85hd" event={"ID":"6f87d17c-bc28-457c-8f92-0a922c782a8f","Type":"ContainerStarted","Data":"96070361093db00b67cce7a237676901d2892739c9247e5a717487a69c6285be"} Jul 07 13:27:40.893219 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.893187 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" event={"ID":"67ba0686-d17c-44ec-ae0a-07569fcad808","Type":"ContainerStarted","Data":"7b742239a95d1a582f91792fea1e876cd1193b0719db910d72bc6de3e92c095f"} Jul 07 13:27:40.902818 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.902617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" event={"ID":"9386b51d35694e977222ff73c9ef8b76","Type":"ContainerStarted","Data":"38d6bb562f0aeae43aebb5b549f40ee7f2259855361924d851ee411b20ce2c63"} Jul 07 13:27:40.925588 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.923902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8tn2" event={"ID":"27a02876-7c8c-424f-a54d-b438c5e9b4fd","Type":"ContainerStarted","Data":"5a3fa92335c7ccdfac4094bf3d1c5166d47b839e3c50e95ddf087f4b1db4c514"} Jul 07 13:27:40.928512 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.928421 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"dc30e91d415328fd7b7de7e2ad72b2633a2f7ba8d4e03662cc43f5c725bf19c7"} Jul 07 13:27:40.934626 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:40.932467 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8vd7z" event={"ID":"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc","Type":"ContainerStarted","Data":"d205691ceeffcd6b9711ec9204edae42c9283d3fb0166090c41209e9310c1a5e"} Jul 07 13:27:41.349152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.349069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:41.349152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.349130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:41.349370 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.349280 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:41.349370 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.349341 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:43.349321782 +0000 UTC m=+5.103732016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:41.349798 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.349775 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:41.349912 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.349842 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:27:43.349827182 +0000 UTC m=+5.104237416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:41.449601 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.449554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:41.449776 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.449745 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:41.449776 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.449773 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:41.449889 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.449787 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:41.449889 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.449843 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:43.44982505 +0000 UTC m=+5.204235289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:41.681235 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.681144 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:22:39 +0000 UTC" deadline="2028-01-12 22:30:40.309401719 +0000 UTC" Jul 07 13:27:41.681235 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.681208 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13305h2m58.628220768s" Jul 07 13:27:41.792175 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.791652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:41.792175 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:41.791789 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:41.801612 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:41.801393 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 13:27:42.797583 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:42.796604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:42.797583 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:42.797045 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:42.797583 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:42.796830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:42.798106 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:42.797678 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:43.362783 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:43.362742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:43.362960 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:43.362800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:43.362960 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.362920 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:43.363068 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.362977 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:47.362957547 +0000 UTC m=+9.117367774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:43.363436 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.363415 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:43.363555 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.363467 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:27:47.363453787 +0000 UTC m=+9.117864016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:43.464107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:43.464064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:43.464284 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.464265 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:43.464284 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.464284 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:43.464384 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.464296 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:43.464384 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.464352 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:47.46433434 +0000 UTC m=+9.218744569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:43.791242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:43.791166 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:43.791407 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:43.791286 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:44.791411 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:44.791380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:44.791841 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:44.791537 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:44.791951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:44.791919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:44.792073 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:44.792016 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:45.790977 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:45.790946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:45.791147 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:45.791065 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:46.795781 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:46.795043 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:46.795781 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:46.795179 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:46.795781 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:46.795598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:46.795781 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:46.795699 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:47.393876 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:47.393841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:47.394073 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:47.393906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:47.394073 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.393973 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:47.394073 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.394027 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:47.394073 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.394043 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:27:55.394028076 +0000 UTC m=+17.148438301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:47.394301 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.394084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:55.394070912 +0000 UTC m=+17.148481142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:47.494683 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:47.494648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:47.494859 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.494833 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:47.494859 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.494855 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:47.494933 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.494867 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:47.494933 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.494917 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:27:55.494903947 +0000 UTC m=+17.249314178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:47.791302 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:47.791219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:47.791467 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:47.791353 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:48.791568 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:48.791513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:48.791961 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:48.791705 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:48.792541 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:48.792520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:48.792626 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:48.792601 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:49.791970 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:49.791892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:49.792354 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:49.792019 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:50.791305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:50.791272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:50.791462 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:50.791272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:50.791462 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:50.791386 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:50.791462 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:50.791445 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:51.791878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:51.791832 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:51.792322 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:51.791956 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:52.791845 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:52.791806 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:52.792038 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:52.791814 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:52.792038 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:52.791941 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:52.792413 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:52.792081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:53.791019 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:53.790981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:53.791206 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:53.791088 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:54.791315 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:54.791283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:54.791778 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:54.791384 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:54.791778 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:54.791474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:54.791778 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:54.791577 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:55.455941 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:55.455898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:55.456176 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:55.455965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:55.456176 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.456049 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:55.456176 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.456107 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:55.456176 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.456130 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:28:11.456106503 +0000 UTC m=+33.210516743 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:27:55.456176 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.456154 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:11.456142661 +0000 UTC m=+33.210552890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:27:55.556564 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:55.556524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:55.556746 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.556715 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:27:55.556746 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.556738 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:27:55.556847 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.556751 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:55.556847 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.556821 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:11.556801884 +0000 UTC m=+33.311212123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:27:55.791680 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:55.791605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:55.792063 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:55.791738 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:56.791204 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:56.791156 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:56.791394 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:56.791303 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:56.791394 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:56.791358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:56.791530 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:56.791466 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:57.791739 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:57.791694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:57.792193 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:57.791848 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:27:58.792587 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:58.792544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:27:58.793011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:58.792648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:27:58.793011 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:58.792766 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:27:58.793011 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:58.792647 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:27:59.791562 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:27:59.791526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:27:59.791718 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:27:59.791657 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:00.791039 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.791018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:00.791335 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.791057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:00.791335 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:00.791136 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:00.791335 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:00.791227 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:00.977931 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.977683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcdvs" event={"ID":"78159fbf-06df-4dcb-b054-e094dc6c5096","Type":"ContainerStarted","Data":"4f0edee4aac9e8b62adab0874a693835ce248400f950479273c9c646d451d619"} Jul 07 13:28:00.979611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.979437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" event={"ID":"6289db9e-4eca-4874-a0ba-8ba369f7cb63","Type":"ContainerStarted","Data":"eee2102611f6c072559239df2e825651e92915f162c000a2b686c88731aab6c1"} Jul 07 13:28:00.980874 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.980852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" event={"ID":"9386b51d35694e977222ff73c9ef8b76","Type":"ContainerStarted","Data":"5f04ca27f0e9766acd603b29abc5688d6a952ae5d555ecd8b1d07d304ae217d7"} Jul 07 13:28:00.982672 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.982649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"7c5525b1d96721f79b040c1cc13bd1721445fb06d488ff4db75f77d24c6a255d"} Jul 07 13:28:00.998640 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:00.998600 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hcdvs" podStartSLOduration=1.436215021 podStartE2EDuration="21.998588475s" totalImagesPullingTime="20.562373454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:00.998384366 +0000 UTC m=+22.752794614" watchObservedRunningTime="2026-07-07 13:28:00.998588475 +0000 UTC m=+22.752998722" Jul 07 13:28:01.022169 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.022110 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-57.ec2.internal" podStartSLOduration=22.022086553 podStartE2EDuration="22.022086553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:01.017779148 +0000 UTC m=+22.772189398" watchObservedRunningTime="2026-07-07 13:28:01.022086553 +0000 UTC m=+22.776496819" Jul 07 13:28:01.036898 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.036852 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zh6n5" podStartSLOduration=2.456335127 podStartE2EDuration="23.036837609s" totalImagesPullingTime="20.580502482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:01.036164231 +0000 UTC m=+22.790574478" watchObservedRunningTime="2026-07-07 13:28:01.036837609 +0000 UTC m=+22.791247856" Jul 07 13:28:01.791275 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.791130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:01.791792 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:01.791347 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:01.985715 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.985681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r62wz" event={"ID":"757215f6-580c-449d-b44e-1cdff953865d","Type":"ContainerStarted","Data":"4947c66724501deed12142c076d5ccfda79c0e19f27bdafe262a71b18e25c51d"} Jul 07 13:28:01.987166 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.987144 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf520380696161bcb2a0b72df4da4cb4" containerID="8ba00a653fe3c4c3c4d25325770166d53d795bdd8a91955862ee3fca13b5bba4" exitCode=0 Jul 07 13:28:01.987263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.987205 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" event={"ID":"cf520380696161bcb2a0b72df4da4cb4","Type":"ContainerDied","Data":"8ba00a653fe3c4c3c4d25325770166d53d795bdd8a91955862ee3fca13b5bba4"} Jul 07 13:28:01.988585 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.988564 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="ad6495176f0aea660a7c45749563fe2efa108e2d707875cfdcede5aae1fc8fea" exitCode=0 Jul 07 13:28:01.988676 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.988623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"ad6495176f0aea660a7c45749563fe2efa108e2d707875cfdcede5aae1fc8fea"} Jul 07 13:28:01.989994 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.989971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c85hd" event={"ID":"6f87d17c-bc28-457c-8f92-0a922c782a8f","Type":"ContainerStarted","Data":"a91e5ae98627cb1aef03f309b0f04f85b5a614184c93b998b9a3e2161a510aa8"} Jul 07 13:28:01.991453 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.991424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" event={"ID":"67ba0686-d17c-44ec-ae0a-07569fcad808","Type":"ContainerStarted","Data":"28217290b4fd70e112bbb1614c4020ef343cb89f58e668242d55223d63b98942"} Jul 07 13:28:01.992801 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.992779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8tn2" event={"ID":"27a02876-7c8c-424f-a54d-b438c5e9b4fd","Type":"ContainerStarted","Data":"702456bc838b64d6b82a53233f55b54735e125eab9d6be0a79a2831446fe5354"} Jul 07 13:28:01.995610 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.995592 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"41033615b277f67278368ebb649205a0cebf8fa1a8e01b21f29882d526686495"} Jul 07 13:28:01.995690 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.995648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"71d8c700f179933d2bd48798007562439184e0a7212e3d309a40c6df5def8543"} Jul 07 13:28:01.995690 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.995678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"a9d0e5dfe75c357d100e98e6c06b777626ab1dc53c24f785b6582df825677e41"} Jul 07 13:28:01.995756 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.995713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"473cc04a8eb3826aca92171bdbb327bf961052cb1d051fa0713e47c3abcba4ca"} Jul 07 13:28:01.995756 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:01.995748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"8f0855c801436eeb63e30e81e120c2939758b51e2be6965a5edd83ba709ff791"} Jul 07 13:28:02.029627 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.029583 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r62wz" podStartSLOduration=2.4887056960000002 podStartE2EDuration="23.029572199s" totalImagesPullingTime="20.540866503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:02.029196557 +0000 UTC m=+23.783606804" watchObservedRunningTime="2026-07-07 13:28:02.029572199 +0000 UTC m=+23.783982447" Jul 07 13:28:02.086158 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.086121 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8tn2" podStartSLOduration=2.609655802 podStartE2EDuration="23.086109057s" totalImagesPullingTime="20.476453255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:02.085543753 +0000 UTC m=+23.839954001" watchObservedRunningTime="2026-07-07 13:28:02.086109057 +0000 UTC m=+23.840519305" Jul 07 13:28:02.105922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.105887 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c85hd" podStartSLOduration=10.910524829 podStartE2EDuration="23.105875275s" totalImagesPullingTime="12.195350446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:02.105389695 +0000 UTC m=+23.859799940" watchObservedRunningTime="2026-07-07 13:28:02.105875275 +0000 UTC m=+23.860285515" Jul 07 13:28:02.791938 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.791906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:02.792474 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.791907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:02.792474 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:02.792031 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:02.792474 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:02.792141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:02.998873 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:02.998833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8vd7z" event={"ID":"5aaf6fc2-b7ed-470e-94d5-5e8d0e1a49fc","Type":"ContainerStarted","Data":"6516475fe2f1aa41ccf6fc6314308bf82bdaf28d3deac4cdc427f135b77893f4"} Jul 07 13:28:03.031843 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.031800 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8vd7z" podStartSLOduration=3.512015585 podStartE2EDuration="24.031785649s" totalImagesPullingTime="20.519770064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:03.015236454 +0000 UTC m=+24.769646702" watchObservedRunningTime="2026-07-07 13:28:03.031785649 +0000 UTC m=+24.786195896" Jul 07 13:28:03.229964 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.229940 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 13:28:03.692082 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.691972 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:28:03.229956383Z","UUID":"19a010d7-d691-44b5-8650-e610fee6217d","Handler":null,"Name":"","Endpoint":""} Jul 07 13:28:03.693553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.693531 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 13:28:03.693694 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.693578 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 13:28:03.790978 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:03.790947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:03.791140 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:03.791050 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:04.004317 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.004283 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" event={"ID":"67ba0686-d17c-44ec-ae0a-07569fcad808","Type":"ContainerStarted","Data":"6d615c281f3c2d31cb3243157f363dc6cb907b51ccc43ceed5b7dec06eea08b2"} Jul 07 13:28:04.008191 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.008166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"a78ce7dd074742b190e4f0ba8a9f14a35f44bf77cbf7d1eefc42902aee71c42a"} Jul 07 13:28:04.009959 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.009931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" event={"ID":"cf520380696161bcb2a0b72df4da4cb4","Type":"ContainerStarted","Data":"98fc3a128b3cac3c1e136ae86ad28b8988ecc01b9cbfd2d06f65662a69309155"} Jul 07 13:28:04.366726 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.366614 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:28:04.367685 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.367662 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:28:04.387963 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.387919 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-57.ec2.internal" podStartSLOduration=25.387905513 podStartE2EDuration="25.387905513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:04.040069819 +0000 UTC m=+25.794480067" watchObservedRunningTime="2026-07-07 13:28:04.387905513 +0000 UTC m=+26.142315761" Jul 07 13:28:04.791749 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.791714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:04.791968 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:04.791760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:04.791968 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:04.791856 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:04.792082 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:04.792014 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:05.013787 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:05.013718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" event={"ID":"67ba0686-d17c-44ec-ae0a-07569fcad808","Type":"ContainerStarted","Data":"015a015f076a6cf2b1a26037214c996ce92bcbddf615d82a1bb96f285be151c8"} Jul 07 13:28:05.014314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:05.013935 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:28:05.014314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:05.014291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c85hd" Jul 07 13:28:05.048509 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:05.048453 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrlkf" podStartSLOduration=3.794669523 podStartE2EDuration="27.048439991s" totalImagesPullingTime="23.253770468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:05.033636997 +0000 UTC m=+26.788047244" watchObservedRunningTime="2026-07-07 13:28:05.048439991 +0000 UTC m=+26.802850230" Jul 07 13:28:05.791502 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:05.791451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:05.791657 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:05.791575 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:06.791888 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:06.791602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:06.792764 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:06.791610 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:06.792764 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:06.791946 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:06.792764 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:06.792039 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:07.023727 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.023687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" event={"ID":"c57cfa93-b25e-4051-a47f-16fa2bda3402","Type":"ContainerStarted","Data":"824349d06983614b3687795f48eeefc9a3dbbfef7c7b89d1c9270c10846eba3d"} Jul 07 13:28:07.024057 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.024036 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:07.024178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.024108 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:07.024178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.024157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:07.043290 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.043227 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:07.044311 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.044284 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:07.056192 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.056151 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" podStartSLOduration=7.361367494 podStartE2EDuration="28.056133732s" totalImagesPullingTime="20.694766238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:07.054661378 +0000 UTC m=+28.809071626" watchObservedRunningTime="2026-07-07 13:28:07.056133732 +0000 UTC m=+28.810543984" Jul 07 13:28:07.791142 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:07.791117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:07.791265 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:07.791211 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:08.370820 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.370601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28spb"] Jul 07 13:28:08.371166 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.370851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:08.371166 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:08.370929 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:08.374710 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.374686 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnlfx"] Jul 07 13:28:08.374839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.374759 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:08.374919 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:08.374835 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:08.375260 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.375235 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtfwr"] Jul 07 13:28:08.375392 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:08.375345 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:08.375462 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:08.375443 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:09.029008 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:09.028969 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="18433c8be6c54a561e6b579a476ebfe79f7f9872409b3b9b1af350bb1072acfe" exitCode=0 Jul 07 13:28:09.029185 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:09.029073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"18433c8be6c54a561e6b579a476ebfe79f7f9872409b3b9b1af350bb1072acfe"} Jul 07 13:28:09.791646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:09.791608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:09.792045 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:09.791715 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:09.792045 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:09.791767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:09.792045 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:09.791896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:10.791545 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:10.791450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:10.791693 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:10.791588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:11.035631 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.035599 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="616a0305b067ce6c21d282b7340fc9f4c884296a12ba48f53a5b6781eeb3b818" exitCode=0 Jul 07 13:28:11.035756 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.035640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"616a0305b067ce6c21d282b7340fc9f4c884296a12ba48f53a5b6781eeb3b818"} Jul 07 13:28:11.484446 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.484411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:11.484601 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.484457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:11.484601 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.484574 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:28:11.484601 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.484574 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 13:28:11.484706 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.484637 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret podName:ccdf5162-4439-4058-90bb-89d7bd1d390d nodeName:}" failed. No retries permitted until 2026-07-07 13:28:43.48461686 +0000 UTC m=+65.239027089 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret") pod "global-pull-secret-syncer-mnlfx" (UID: "ccdf5162-4439-4058-90bb-89d7bd1d390d") : object "kube-system"/"original-pull-secret" not registered Jul 07 13:28:11.484706 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.484655 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs podName:ddaa8868-5ebe-483d-bd25-99a8aac38344 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:43.484646625 +0000 UTC m=+65.239056854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs") pod "network-metrics-daemon-dtfwr" (UID: "ddaa8868-5ebe-483d-bd25-99a8aac38344") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 13:28:11.585060 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.585033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:11.585210 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.585176 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 13:28:11.585260 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.585213 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 13:28:11.585260 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.585223 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mp6q8 for pod openshift-network-diagnostics/network-check-target-28spb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:28:11.585343 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.585268 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8 podName:6533eafa-d765-49c6-829a-304cd44828a9 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:43.585256568 +0000 UTC m=+65.339666794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mp6q8" (UniqueName: "kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8") pod "network-check-target-28spb" (UID: "6533eafa-d765-49c6-829a-304cd44828a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 13:28:11.791908 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.791817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:11.792378 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.791948 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:11.792378 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:11.791977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:11.792378 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:11.792037 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:12.791351 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:12.791270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:12.791520 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:12.791407 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28spb" podUID="6533eafa-d765-49c6-829a-304cd44828a9" Jul 07 13:28:13.042119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:13.042029 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="28ed79957bc907ed74d8329087dc4bf13ce27ad905aabfa03466d220e11f0380" exitCode=0 Jul 07 13:28:13.042119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:13.042085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"28ed79957bc907ed74d8329087dc4bf13ce27ad905aabfa03466d220e11f0380"} Jul 07 13:28:13.791893 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:13.791706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:13.792054 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:13.791762 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:13.792054 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:13.791991 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mnlfx" podUID="ccdf5162-4439-4058-90bb-89d7bd1d390d" Jul 07 13:28:13.792155 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:13.792052 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfwr" podUID="ddaa8868-5ebe-483d-bd25-99a8aac38344" Jul 07 13:28:14.566331 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.566302 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-57.ec2.internal" event="NodeReady" Jul 07 13:28:14.566760 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.566474 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 13:28:14.606137 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.606105 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:28:14.627238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.627216 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2"] Jul 07 13:28:14.627359 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.627341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.630553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.630528 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 13:28:14.630687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.630601 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mmkl7\"" Jul 07 13:28:14.631403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.631383 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 13:28:14.631535 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.631383 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 13:28:14.646376 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.644650 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 13:28:14.646376 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.645406 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7448b4689c-ctzmt"] Jul 07 13:28:14.646376 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.645517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" Jul 07 13:28:14.648787 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.648768 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.649025 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.649004 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.649161 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.649145 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sjns6\"" Jul 07 13:28:14.663712 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.663244 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q"] Jul 07 13:28:14.663712 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.663411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.670110 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.670090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.671188 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671166 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f6h9s\"" Jul 07 13:28:14.671282 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671231 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 13:28:14.671335 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671177 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.671460 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671443 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 13:28:14.671531 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671457 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 13:28:14.671811 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.671607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 13:28:14.691360 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.691338 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h"] Jul 07 13:28:14.691627 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.691603 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.694273 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.694250 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 13:28:14.694364 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.694344 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l5vp9\"" Jul 07 13:28:14.694364 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.694352 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.694532 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.694518 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.711374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711524 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711524 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711524 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711524 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711474 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn"] Jul 07 13:28:14.711736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws99l\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.711736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.711646 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.715362 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.715186 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 13:28:14.715652 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.715627 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.715988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.715973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.716253 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.716235 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n9rh9\"" Jul 07 13:28:14.718884 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.716990 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 13:28:14.736807 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.736786 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-srfxv"] Jul 07 13:28:14.736921 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.736904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:14.740688 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.740669 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.741054 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.741035 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 13:28:14.741285 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.741269 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4n5fh\"" Jul 07 13:28:14.741403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.741271 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.741516 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.741478 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 13:28:14.758927 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.758903 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:28:14.759004 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.758951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.759004 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.758968 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t7lt4"] Jul 07 13:28:14.762222 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.762201 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.762222 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.762229 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f7b88\"" Jul 07 13:28:14.762346 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.762267 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 13:28:14.762346 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.762230 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 13:28:14.762346 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.762230 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.768591 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.768572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 13:28:14.783036 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.783014 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q"] Jul 07 13:28:14.783119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.783062 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2"] Jul 07 13:28:14.783119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.783078 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n"] Jul 07 13:28:14.783119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.783022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:14.785770 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.785748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 13:28:14.785853 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.785788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 13:28:14.785920 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.785880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rgbgq\"" Jul 07 13:28:14.797723 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.797706 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v9985"] Jul 07 13:28:14.797807 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.797756 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:14.797853 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.797839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:14.800230 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800211 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 13:28:14.800321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800250 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z824\"" Jul 07 13:28:14.800321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800303 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.800509 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800477 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.800591 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800575 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 13:28:14.800640 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800611 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f4jg2\"" Jul 07 13:28:14.800840 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.800827 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.801560 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.801546 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.812055 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812038 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-d5dmw"] Jul 07 13:28:14.812134 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.812134 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cvn4\" (UniqueName: \"kubernetes.io/projected/31d159de-0ec9-4960-8847-c888e7910f3b-kube-api-access-7cvn4\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.812134 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-stats-auth\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.812288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.812288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812158 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" Jul 07 13:28:14.812288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttv7\" (UniqueName: \"kubernetes.io/projected/4f9f6acf-a05c-4334-b5fc-670fb00a5698-kube-api-access-sttv7\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.812288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96c3b07c-ccf6-4743-aeb6-538acbc0f175-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-default-certificate\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812526 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws99l\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv7kh\" (UniqueName: \"kubernetes.io/projected/96c3b07c-ccf6-4743-aeb6-538acbc0f175-kube-api-access-tv7kh\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9pg\" (UniqueName: \"kubernetes.io/projected/93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2-kube-api-access-gd9pg\") pod \"volume-data-source-validator-5d456fdbcd-qk8w2\" (UID: \"93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.812804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.812719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.813085 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.812824 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:14.813085 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.812834 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:14.813085 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.812869 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.312856844 +0000 UTC m=+37.067267070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:14.813216 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.813147 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.813360 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.813342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.813594 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.813545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.815120 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.815102 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4g4gd\"" Jul 07 13:28:14.816638 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.816620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.816638 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.816630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.821741 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.821723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.822106 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.822088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws99l\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:14.844095 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.844070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:14.846783 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.846768 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4wc7d\"" Jul 07 13:28:14.846987 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.846969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 13:28:14.846987 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.846979 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 13:28:14.847153 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.847037 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.847153 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.847077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.847581 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.847566 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cts4l"] Jul 07 13:28:14.851897 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.851878 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 13:28:14.862083 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:14.862083 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862068 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h"] Jul 07 13:28:14.862177 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862132 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-srfxv"] Jul 07 13:28:14.862177 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862147 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn"] Jul 07 13:28:14.862177 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862160 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t7lt4"] Jul 07 13:28:14.862177 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862175 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v9985"] Jul 07 13:28:14.862321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862193 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-d5dmw"] Jul 07 13:28:14.862321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n"] Jul 07 13:28:14.862321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7448b4689c-ctzmt"] Jul 07 13:28:14.862321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.862279 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cts4l"] Jul 07 13:28:14.864706 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.864690 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 13:28:14.864706 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.864703 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 13:28:14.864825 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.864714 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twdpw\"" Jul 07 13:28:14.864825 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.864764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 13:28:14.913678 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.913678 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5bb81ef-dc31-4066-baba-8a89135f44d2-serving-cert\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cvn4\" (UniqueName: \"kubernetes.io/projected/31d159de-0ec9-4960-8847-c888e7910f3b-kube-api-access-7cvn4\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxj2\" (UniqueName: \"kubernetes.io/projected/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-kube-api-access-mkxj2\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.913790 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:14.913839 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.913824 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.413803002 +0000 UTC m=+37.168213262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttv7\" (UniqueName: \"kubernetes.io/projected/4f9f6acf-a05c-4334-b5fc-670fb00a5698-kube-api-access-sttv7\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.913860 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.413842002 +0000 UTC m=+37.168252242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j42dk\" (UniqueName: \"kubernetes.io/projected/d5bb81ef-dc31-4066-baba-8a89135f44d2-kube-api-access-j42dk\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.913988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-default-certificate\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.914012 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-tmp-dir\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2lw\" (UniqueName: \"kubernetes.io/projected/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-kube-api-access-qf2lw\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.914071 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.414054869 +0000 UTC m=+37.168465110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:14.914122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv7kh\" (UniqueName: \"kubernetes.io/projected/96c3b07c-ccf6-4743-aeb6-538acbc0f175-kube-api-access-tv7kh\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-config\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-stats-auth\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76ck\" (UniqueName: \"kubernetes.io/projected/5d53a5a4-f484-4b66-a3f9-c497f60a4a44-kube-api-access-x76ck\") pod \"network-check-source-989f8b8dc-v9985\" (UID: \"5d53a5a4-f484-4b66-a3f9-c497f60a4a44\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht8nk\" (UniqueName: \"kubernetes.io/projected/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-kube-api-access-ht8nk\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96c3b07c-ccf6-4743-aeb6-538acbc0f175-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.914506 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-config-volume\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.914573 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:14.914568 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.414551687 +0000 UTC m=+37.168961914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:14.915178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:14.915178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9pg\" (UniqueName: \"kubernetes.io/projected/93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2-kube-api-access-gd9pg\") pod \"volume-data-source-validator-5d456fdbcd-qk8w2\" (UID: \"93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" Jul 07 13:28:14.915178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-tmp\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.915178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.914798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-snapshots\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:14.915333 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.915192 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/96c3b07c-ccf6-4743-aeb6-538acbc0f175-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.916832 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.916803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-default-certificate\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.916986 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.916963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-stats-auth\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.927948 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.927912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cvn4\" (UniqueName: \"kubernetes.io/projected/31d159de-0ec9-4960-8847-c888e7910f3b-kube-api-access-7cvn4\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:14.928203 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.928179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv7kh\" (UniqueName: \"kubernetes.io/projected/96c3b07c-ccf6-4743-aeb6-538acbc0f175-kube-api-access-tv7kh\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:14.928350 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.928262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9pg\" (UniqueName: \"kubernetes.io/projected/93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2-kube-api-access-gd9pg\") pod \"volume-data-source-validator-5d456fdbcd-qk8w2\" (UID: \"93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" Jul 07 13:28:14.930030 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.930012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttv7\" (UniqueName: \"kubernetes.io/projected/4f9f6acf-a05c-4334-b5fc-670fb00a5698-kube-api-access-sttv7\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:14.957573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:14.957549 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" Jul 07 13:28:15.015733 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvmm\" (UniqueName: \"kubernetes.io/projected/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-kube-api-access-fmvmm\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.015837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-serving-cert\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.015837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-tmp-dir\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.015837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2lw\" (UniqueName: \"kubernetes.io/projected/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-kube-api-access-qf2lw\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.015837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-trusted-ca\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.015837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.016011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-config\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.016011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-cert\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.016011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76ck\" (UniqueName: \"kubernetes.io/projected/5d53a5a4-f484-4b66-a3f9-c497f60a4a44-kube-api-access-x76ck\") pod \"network-check-source-989f8b8dc-v9985\" (UID: \"5d53a5a4-f484-4b66-a3f9-c497f60a4a44\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" Jul 07 13:28:15.016011 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.015963 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:15.016011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.015980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht8nk\" (UniqueName: \"kubernetes.io/projected/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-kube-api-access-ht8nk\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.016015 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:15.515997732 +0000 UTC m=+37.270407962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-config-volume\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-tmp-dir\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79v7g\" (UniqueName: \"kubernetes.io/projected/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-kube-api-access-79v7g\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.016190 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-config\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-tmp\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-snapshots\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5bb81ef-dc31-4066-baba-8a89135f44d2-serving-cert\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.016437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxj2\" (UniqueName: \"kubernetes.io/projected/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-kube-api-access-mkxj2\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.016665 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j42dk\" (UniqueName: \"kubernetes.io/projected/d5bb81ef-dc31-4066-baba-8a89135f44d2-kube-api-access-j42dk\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.016733 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016713 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-config\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.016791 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.016722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-config-volume\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.017078 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.017049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-tmp\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.017265 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.017241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.017742 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.017460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.017742 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.017540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d5bb81ef-dc31-4066-baba-8a89135f44d2-snapshots\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.018267 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.018225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5bb81ef-dc31-4066-baba-8a89135f44d2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.019620 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.019597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.019620 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.019611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.019967 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.019944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5bb81ef-dc31-4066-baba-8a89135f44d2-serving-cert\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.026199 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.026179 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2lw\" (UniqueName: \"kubernetes.io/projected/92b3304f-5537-4aa1-aaa3-3ee4298a8da6-kube-api-access-qf2lw\") pod \"service-ca-operator-5d46d9ffd4-q5l4n\" (UID: \"92b3304f-5537-4aa1-aaa3-3ee4298a8da6\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.026581 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.026524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht8nk\" (UniqueName: \"kubernetes.io/projected/d9d271ef-f34e-4d37-94c0-b282e06dbb1c-kube-api-access-ht8nk\") pod \"kube-storage-version-migrator-operator-846bf668f7-h7hkn\" (UID: \"d9d271ef-f34e-4d37-94c0-b282e06dbb1c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.028295 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.028254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxj2\" (UniqueName: \"kubernetes.io/projected/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-kube-api-access-mkxj2\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.028706 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.028659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j42dk\" (UniqueName: \"kubernetes.io/projected/d5bb81ef-dc31-4066-baba-8a89135f44d2-kube-api-access-j42dk\") pod \"insights-operator-5c847dcfc4-srfxv\" (UID: \"d5bb81ef-dc31-4066-baba-8a89135f44d2\") " pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.033091 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.033071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76ck\" (UniqueName: \"kubernetes.io/projected/5d53a5a4-f484-4b66-a3f9-c497f60a4a44-kube-api-access-x76ck\") pod \"network-check-source-989f8b8dc-v9985\" (UID: \"5d53a5a4-f484-4b66-a3f9-c497f60a4a44\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" Jul 07 13:28:15.046416 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.046391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" Jul 07 13:28:15.069247 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.068988 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" Jul 07 13:28:15.107304 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.107093 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" Jul 07 13:28:15.117843 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.117800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvmm\" (UniqueName: \"kubernetes.io/projected/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-kube-api-access-fmvmm\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.117995 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.117851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-serving-cert\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.117995 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.117884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-trusted-ca\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.117995 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.117952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-cert\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.118127 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.118033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79v7g\" (UniqueName: \"kubernetes.io/projected/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-kube-api-access-79v7g\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.118127 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.118060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-config\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.118937 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.118902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-config\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.119332 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.119293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-trusted-ca\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.121883 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.121837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-cert\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.123749 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.123717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-serving-cert\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.129103 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.129045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79v7g\" (UniqueName: \"kubernetes.io/projected/b0a8e5c1-93e9-4671-ab5f-a6bddced9127-kube-api-access-79v7g\") pod \"ingress-canary-cts4l\" (UID: \"b0a8e5c1-93e9-4671-ab5f-a6bddced9127\") " pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.129902 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.129868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvmm\" (UniqueName: \"kubernetes.io/projected/2bfbeeb5-2f77-41ad-891b-9af9f80f359a-kube-api-access-fmvmm\") pod \"console-operator-68b757fb67-d5dmw\" (UID: \"2bfbeeb5-2f77-41ad-891b-9af9f80f359a\") " pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.133736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.133335 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" Jul 07 13:28:15.153025 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.152784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:15.171297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.171263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cts4l" Jul 07 13:28:15.205474 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.202473 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2"] Jul 07 13:28:15.274717 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.274678 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn"] Jul 07 13:28:15.330963 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.330204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:15.330963 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.330408 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:15.330963 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.330424 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:15.330963 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.330477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.330459054 +0000 UTC m=+38.084869293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:15.366211 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.366126 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-srfxv"] Jul 07 13:28:15.370691 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:15.370411 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bb81ef_dc31_4066_baba_8a89135f44d2.slice/crio-faad3c7ab2b0fc0fd74ffbdf7e070af1a65bcdcc73ac0a9fea3fd454ba9cef99 WatchSource:0}: Error finding container faad3c7ab2b0fc0fd74ffbdf7e070af1a65bcdcc73ac0a9fea3fd454ba9cef99: Status 404 returned error can't find the container with id faad3c7ab2b0fc0fd74ffbdf7e070af1a65bcdcc73ac0a9fea3fd454ba9cef99 Jul 07 13:28:15.387170 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.387063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n"] Jul 07 13:28:15.418115 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.418069 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cts4l"] Jul 07 13:28:15.420430 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:15.420408 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a8e5c1_93e9_4671_ab5f_a6bddced9127.slice/crio-3e65800420f27aeefce474d29d2b669504c460ae4419f465d7e70087853b4a16 WatchSource:0}: Error finding container 3e65800420f27aeefce474d29d2b669504c460ae4419f465d7e70087853b4a16: Status 404 returned error can't find the container with id 3e65800420f27aeefce474d29d2b669504c460ae4419f465d7e70087853b4a16 Jul 07 13:28:15.428623 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.428597 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-d5dmw"] Jul 07 13:28:15.430612 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.430588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.430693 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.430839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.430858 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.430838466 +0000 UTC m=+38.185248707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:15.430750 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfbeeb5_2f77_41ad_891b_9af9f80f359a.slice/crio-a9f7a997ad0d698ab08e744c888c81e322d4ec8ec7cf2bdbfd411f8a7954247e WatchSource:0}: Error finding container a9f7a997ad0d698ab08e744c888c81e322d4ec8ec7cf2bdbfd411f8a7954247e: Status 404 returned error can't find the container with id a9f7a997ad0d698ab08e744c888c81e322d4ec8ec7cf2bdbfd411f8a7954247e Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.430920 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.430935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.430957 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.430944615 +0000 UTC m=+38.185354843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.430985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.430996 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:15.431044 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.431026 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.431016603 +0000 UTC m=+38.185426843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:15.431511 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.431081 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.431071875 +0000 UTC m=+38.185482103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:15.532079 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.532046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:15.532248 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.532224 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:15.532330 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:15.532311 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:16.532286117 +0000 UTC m=+38.286696357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:15.621688 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.621661 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-v9985"] Jul 07 13:28:15.624384 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:15.624357 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d53a5a4_f484_4b66_a3f9_c497f60a4a44.slice/crio-1be5265a864bf0e7e536056c3cba24ef3902147f3c282c87cb8c8087a0bd718c WatchSource:0}: Error finding container 1be5265a864bf0e7e536056c3cba24ef3902147f3c282c87cb8c8087a0bd718c: Status 404 returned error can't find the container with id 1be5265a864bf0e7e536056c3cba24ef3902147f3c282c87cb8c8087a0bd718c Jul 07 13:28:15.791717 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.791650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:15.791879 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.791813 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:15.794591 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.794572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:28:15.794691 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.794635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6stv\"" Jul 07 13:28:15.794691 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:15.794643 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:28:16.052344 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.052219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" event={"ID":"2bfbeeb5-2f77-41ad-891b-9af9f80f359a","Type":"ContainerStarted","Data":"a9f7a997ad0d698ab08e744c888c81e322d4ec8ec7cf2bdbfd411f8a7954247e"} Jul 07 13:28:16.054649 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.054584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" event={"ID":"5d53a5a4-f484-4b66-a3f9-c497f60a4a44","Type":"ContainerStarted","Data":"1be5265a864bf0e7e536056c3cba24ef3902147f3c282c87cb8c8087a0bd718c"} Jul 07 13:28:16.055973 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.055917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" event={"ID":"d5bb81ef-dc31-4066-baba-8a89135f44d2","Type":"ContainerStarted","Data":"faad3c7ab2b0fc0fd74ffbdf7e070af1a65bcdcc73ac0a9fea3fd454ba9cef99"} Jul 07 13:28:16.058541 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.058513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" event={"ID":"d9d271ef-f34e-4d37-94c0-b282e06dbb1c","Type":"ContainerStarted","Data":"7c79386a4e77adfe73e0259aa1f6537336aa0ba694beed414a90972e2158368b"} Jul 07 13:28:16.060429 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.060326 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" event={"ID":"93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2","Type":"ContainerStarted","Data":"fcac008eaf1243782a13d3e6d2fae2441c427f3b0bb135b51e873308d18f1b0d"} Jul 07 13:28:16.061622 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.061556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cts4l" event={"ID":"b0a8e5c1-93e9-4671-ab5f-a6bddced9127","Type":"ContainerStarted","Data":"3e65800420f27aeefce474d29d2b669504c460ae4419f465d7e70087853b4a16"} Jul 07 13:28:16.062946 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.062890 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" event={"ID":"92b3304f-5537-4aa1-aaa3-3ee4298a8da6","Type":"ContainerStarted","Data":"6c4a4185a886f83d93b71e1e7ce62e2e93bcc83c7c5ec0dd24a5828ceb3d2524"} Jul 07 13:28:16.339981 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.339203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:16.339981 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.339424 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:16.339981 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.339439 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:16.339981 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.339544 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.339522906 +0000 UTC m=+40.093933139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.440779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.440842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.440891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.441000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441142 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441204 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.441185688 +0000 UTC m=+40.195595919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:16.441623 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441638 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:16.442123 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441641 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:16.442123 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441696 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.441680738 +0000 UTC m=+40.196090979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:16.442123 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441744 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.441722517 +0000 UTC m=+40.196132759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:16.442123 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.441764 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.441754651 +0000 UTC m=+40.196164882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:16.542384 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:16.542349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:16.542769 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.542747 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:16.542856 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:16.542816 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:18.5427974 +0000 UTC m=+40.297207649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:18.076931 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.076595 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" event={"ID":"93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2","Type":"ContainerStarted","Data":"51782a5f750c7be98614bf2a2ef110a620736721232c9dee2481865f56207e54"} Jul 07 13:28:18.094211 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.094154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qk8w2" podStartSLOduration=15.933042517 podStartE2EDuration="18.09413354s" totalImagesPullingTime="2.161091023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:18.093431668 +0000 UTC m=+39.847841919" watchObservedRunningTime="2026-07-07 13:28:18.09413354 +0000 UTC m=+39.848543789" Jul 07 13:28:18.362687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.362515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:18.362687 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.362660 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:18.362687 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.362677 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:18.363233 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.362743 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.362724546 +0000 UTC m=+44.117134772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:18.463297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.463256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.463384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463411 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.463452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463474 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.46345532 +0000 UTC m=+44.217865563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.463523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463534 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:18.463607 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.463564012 +0000 UTC m=+44.217974253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:18.463934 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463623 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:18.463934 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463651 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.463641998 +0000 UTC m=+44.218052227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:18.463934 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.463665 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.463657069 +0000 UTC m=+44.218067294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:18.564234 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:18.564199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:18.564414 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.564394 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:18.564478 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:18.564467 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:22.564448846 +0000 UTC m=+44.318859085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:22.392932 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.392894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:22.393419 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.393074 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:22.393419 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.393095 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:22.393419 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.393159 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.393138098 +0000 UTC m=+52.147548327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:22.493757 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.493719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:22.493757 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.493764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.493809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.493885 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.493919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.493951 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.493935928 +0000 UTC m=+52.248346158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.493966 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.493960042 +0000 UTC m=+52.248370268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:22.493982 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.493978 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:22.494244 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.494004 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:22.494244 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.494043 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.494023451 +0000 UTC m=+52.248433678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:22.494244 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.494061 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.494052694 +0000 UTC m=+52.248462924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:22.594871 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:22.594837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:22.595109 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.595002 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:22.595109 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:22.595078 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:30.595057646 +0000 UTC m=+52.349468079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:25.953572 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.953532 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-thgtm"] Jul 07 13:28:25.974386 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.974362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:25.980983 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.980949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-thgtm"] Jul 07 13:28:25.981290 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.981265 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 13:28:25.981571 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.981549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 13:28:25.981695 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:25.981582 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t5s5h\"" Jul 07 13:28:26.024744 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.024372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa744534-a05e-4976-b40f-b08cb5967ae5-crio-socket\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.024744 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.024526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.024744 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.024561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsr7\" (UniqueName: \"kubernetes.io/projected/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-api-access-pxsr7\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.024744 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.024589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.024744 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.024632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa744534-a05e-4976-b40f-b08cb5967ae5-data-volume\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.098978 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.098955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/0.log" Jul 07 13:28:26.099141 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.098993 2565 generic.go:356] "Generic (PLEG): container finished" podID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" containerID="126da55efe94a902e423122bc11793fe528d149f39f90bd8c68e3fc0f3a569ef" exitCode=255 Jul 07 13:28:26.099141 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.099055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" event={"ID":"2bfbeeb5-2f77-41ad-891b-9af9f80f359a","Type":"ContainerDied","Data":"126da55efe94a902e423122bc11793fe528d149f39f90bd8c68e3fc0f3a569ef"} Jul 07 13:28:26.099354 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.099332 2565 scope.go:117] "RemoveContainer" containerID="126da55efe94a902e423122bc11793fe528d149f39f90bd8c68e3fc0f3a569ef" Jul 07 13:28:26.100872 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.100844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" event={"ID":"5d53a5a4-f484-4b66-a3f9-c497f60a4a44","Type":"ContainerStarted","Data":"6f9f604dba27439bb2b68f2b0fdb5567f3b556b521cd363c71db65e42a475dcc"} Jul 07 13:28:26.102370 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.102349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" event={"ID":"d5bb81ef-dc31-4066-baba-8a89135f44d2","Type":"ContainerStarted","Data":"8dc8030170ccf81d403227fcef5ee1f0ca3a622c3952b37becb59fc9e9b4d4f5"} Jul 07 13:28:26.105391 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.105371 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="334a2d1b341cfb5e85589222ce858ec1ffc06febda00d1fbc4502b6b29a8de51" exitCode=0 Jul 07 13:28:26.105478 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.105445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"334a2d1b341cfb5e85589222ce858ec1ffc06febda00d1fbc4502b6b29a8de51"} Jul 07 13:28:26.107034 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.107012 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" event={"ID":"d9d271ef-f34e-4d37-94c0-b282e06dbb1c","Type":"ContainerStarted","Data":"0a324d800688de08b2c4e58c81a86e2c078a0c8cf26407de9ba6e50b24157349"} Jul 07 13:28:26.108444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.108424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cts4l" event={"ID":"b0a8e5c1-93e9-4671-ab5f-a6bddced9127","Type":"ContainerStarted","Data":"6dd10707aa298ff9f688fb3dee74ab3fc59559902022af32fdfbd1a7839ca1ef"} Jul 07 13:28:26.109822 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.109799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" event={"ID":"92b3304f-5537-4aa1-aaa3-3ee4298a8da6","Type":"ContainerStarted","Data":"5dfb007976d440e2c2359adbae63f8aae38939a9f8d7a6309e674db293d20f58"} Jul 07 13:28:26.124912 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.124891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa744534-a05e-4976-b40f-b08cb5967ae5-crio-socket\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.125797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.125774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.125859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.125847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsr7\" (UniqueName: \"kubernetes.io/projected/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-api-access-pxsr7\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.125914 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.125886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.125994 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.125979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa744534-a05e-4976-b40f-b08cb5967ae5-data-volume\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.126253 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.126236 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:28:26.126306 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.126297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:26.626277514 +0000 UTC m=+48.380687755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : secret "insights-runtime-extractor-tls" not found Jul 07 13:28:26.127312 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.126886 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:28:26.127312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.126941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa744534-a05e-4976-b40f-b08cb5967ae5-data-volume\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.127312 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.126968 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:26.626951224 +0000 UTC m=+48.381361463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : configmap "kube-rbac-proxy" not found Jul 07 13:28:26.127562 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.127530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa744534-a05e-4976-b40f-b08cb5967ae5-crio-socket\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.136318 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.136295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsr7\" (UniqueName: \"kubernetes.io/projected/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-api-access-pxsr7\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.155986 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.155941 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-v9985" podStartSLOduration=16.700255506 podStartE2EDuration="26.155923871s" totalImagesPullingTime="9.455668365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:26.15440432 +0000 UTC m=+47.908814569" watchObservedRunningTime="2026-07-07 13:28:26.155923871 +0000 UTC m=+47.910334122" Jul 07 13:28:26.178720 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.178665 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cts4l" podStartSLOduration=2.5302650399999997 podStartE2EDuration="12.178647256s" totalImagesPullingTime="9.648382216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:26.177272189 +0000 UTC m=+47.931682438" watchObservedRunningTime="2026-07-07 13:28:26.178647256 +0000 UTC m=+47.933057505" Jul 07 13:28:26.200944 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.199754 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" podStartSLOduration=16.436108457 podStartE2EDuration="26.199734205s" totalImagesPullingTime="9.763625748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:26.199058527 +0000 UTC m=+47.953468778" watchObservedRunningTime="2026-07-07 13:28:26.199734205 +0000 UTC m=+47.954144454" Jul 07 13:28:26.256333 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.256280 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" podStartSLOduration=16.57287375 podStartE2EDuration="26.256258071s" totalImagesPullingTime="9.683384321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:26.222966235 +0000 UTC m=+47.977376484" watchObservedRunningTime="2026-07-07 13:28:26.256258071 +0000 UTC m=+48.010668324" Jul 07 13:28:26.277330 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.276910 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" podStartSLOduration=16.578867789 podStartE2EDuration="26.276889632s" totalImagesPullingTime="9.698021843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:26.275794733 +0000 UTC m=+48.030204981" watchObservedRunningTime="2026-07-07 13:28:26.276889632 +0000 UTC m=+48.031299882" Jul 07 13:28:26.631323 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.631289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.631475 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:26.631341 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:26.631475 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.631422 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:28:26.631602 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.631480 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:27.63146311 +0000 UTC m=+49.385873352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : configmap "kube-rbac-proxy" not found Jul 07 13:28:26.631602 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.631513 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:28:26.631602 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:26.631582 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:27.63156343 +0000 UTC m=+49.385973660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : secret "insights-runtime-extractor-tls" not found Jul 07 13:28:27.116220 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116152 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:28:27.116656 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116640 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/0.log" Jul 07 13:28:27.116707 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116676 2565 generic.go:356] "Generic (PLEG): container finished" podID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" containerID="18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed" exitCode=255 Jul 07 13:28:27.116819 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" event={"ID":"2bfbeeb5-2f77-41ad-891b-9af9f80f359a","Type":"ContainerDied","Data":"18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed"} Jul 07 13:28:27.116819 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116768 2565 scope.go:117] "RemoveContainer" containerID="126da55efe94a902e423122bc11793fe528d149f39f90bd8c68e3fc0f3a569ef" Jul 07 13:28:27.117017 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.116993 2565 scope.go:117] "RemoveContainer" containerID="18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed" Jul 07 13:28:27.117458 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:27.117251 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-d5dmw_openshift-console-operator(2bfbeeb5-2f77-41ad-891b-9af9f80f359a)\"" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podUID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" Jul 07 13:28:27.119967 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.119947 2565 generic.go:356] "Generic (PLEG): container finished" podID="6686a05e-3fc1-4fc7-9412-2f3c9d6bb537" containerID="998c103ef6230f392f3d9a9d896acc05ca028457572b554284ee7619cb0a044c" exitCode=0 Jul 07 13:28:27.120062 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.120027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerDied","Data":"998c103ef6230f392f3d9a9d896acc05ca028457572b554284ee7619cb0a044c"} Jul 07 13:28:27.640321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.640284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:27.640321 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.640322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:27.640559 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:27.640436 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:28:27.640559 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:27.640443 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 13:28:27.640559 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:27.640516 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:29.640500289 +0000 UTC m=+51.394910528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : secret "insights-runtime-extractor-tls" not found Jul 07 13:28:27.640559 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:27.640532 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:29.640525298 +0000 UTC m=+51.394935524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : configmap "kube-rbac-proxy" not found Jul 07 13:28:27.952802 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:27.952724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8tn2_27a02876-7c8c-424f-a54d-b438c5e9b4fd/dns-node-resolver/0.log" Jul 07 13:28:28.125163 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:28.125134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:28:28.125611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:28.125507 2565 scope.go:117] "RemoveContainer" containerID="18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed" Jul 07 13:28:28.125689 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:28.125669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-d5dmw_openshift-console-operator(2bfbeeb5-2f77-41ad-891b-9af9f80f359a)\"" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podUID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" Jul 07 13:28:28.128537 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:28.128506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" event={"ID":"6686a05e-3fc1-4fc7-9412-2f3c9d6bb537","Type":"ContainerStarted","Data":"e42473cf1b33bf585ea7642a48adcd2aa49171910275b31f95eaf36236a9e44d"} Jul 07 13:28:28.177746 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:28.177689 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m2xqj" podStartSLOduration=8.054536415 podStartE2EDuration="49.17767418s" totalImagesPullingTime="41.123137765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:28.177132717 +0000 UTC m=+49.931542964" watchObservedRunningTime="2026-07-07 13:28:28.17767418 +0000 UTC m=+49.932084428" Jul 07 13:28:28.754663 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:28.754638 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r62wz_757215f6-580c-449d-b44e-1cdff953865d/node-ca/0.log" Jul 07 13:28:29.551961 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:29.551935 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cts4l_b0a8e5c1-93e9-4671-ab5f-a6bddced9127/serve-healthcheck-canary/0.log" Jul 07 13:28:29.656914 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:29.656878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:29.656914 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:29.656917 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:29.657094 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:29.657041 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:28:29.657170 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:29.657159 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:33.657140233 +0000 UTC m=+55.411550479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : secret "insights-runtime-extractor-tls" not found Jul 07 13:28:29.657578 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:29.657561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa744534-a05e-4976-b40f-b08cb5967ae5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:30.463183 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.463149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:30.463358 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.463309 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 13:28:30.463358 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.463325 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc489dd9c-2qfw2: secret "image-registry-tls" not found Jul 07 13:28:30.463428 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.463389 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls podName:b45b3861-315b-4432-9a9c-26c2e3911a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.463373148 +0000 UTC m=+68.217783380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls") pod "image-registry-fc489dd9c-2qfw2" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04") : secret "image-registry-tls" not found Jul 07 13:28:30.564617 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.564583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.564701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564735 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.564770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564805 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls podName:96c3b07c-ccf6-4743-aeb6-538acbc0f175 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.564788132 +0000 UTC m=+68.319198363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-drl7h" (UID: "96c3b07c-ccf6-4743-aeb6-538acbc0f175") : secret "cluster-monitoring-operator-tls" not found Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.564820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564858 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.564893148 +0000 UTC m=+68.319303376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : configmap references non-existent config key: service-ca.crt Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564925 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls podName:31d159de-0ec9-4960-8847-c888e7910f3b nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.56491236 +0000 UTC m=+68.319322586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-6727q" (UID: "31d159de-0ec9-4960-8847-c888e7910f3b") : secret "samples-operator-tls" not found Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564858 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 13:28:30.565069 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.564959 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs podName:4f9f6acf-a05c-4334-b5fc-670fb00a5698 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.564952356 +0000 UTC m=+68.319362581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs") pod "router-default-7448b4689c-ctzmt" (UID: "4f9f6acf-a05c-4334-b5fc-670fb00a5698") : secret "router-metrics-certs-default" not found Jul 07 13:28:30.665181 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:30.665149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:30.665292 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.665270 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 13:28:30.665331 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:30.665322 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls podName:8fe4816a-6fed-44ce-8c7c-e2790197e7a8 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:46.665303339 +0000 UTC m=+68.419713565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls") pod "dns-default-t7lt4" (UID: "8fe4816a-6fed-44ce-8c7c-e2790197e7a8") : secret "dns-default-metrics-tls" not found Jul 07 13:28:33.692630 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:33.692591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:33.693085 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:33.692701 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 13:28:33.693085 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:33.692766 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls podName:aa744534-a05e-4976-b40f-b08cb5967ae5 nodeName:}" failed. No retries permitted until 2026-07-07 13:28:41.692747325 +0000 UTC m=+63.447157554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-thgtm" (UID: "aa744534-a05e-4976-b40f-b08cb5967ae5") : secret "insights-runtime-extractor-tls" not found Jul 07 13:28:35.153304 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:35.153276 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:35.153713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:35.153319 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:35.153713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:35.153650 2565 scope.go:117] "RemoveContainer" containerID="18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed" Jul 07 13:28:35.153803 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:28:35.153786 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-d5dmw_openshift-console-operator(2bfbeeb5-2f77-41ad-891b-9af9f80f359a)\"" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podUID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" Jul 07 13:28:39.039809 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:39.039783 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqlzl" Jul 07 13:28:41.759613 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:41.759570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:41.762005 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:41.761978 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa744534-a05e-4976-b40f-b08cb5967ae5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thgtm\" (UID: \"aa744534-a05e-4976-b40f-b08cb5967ae5\") " pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:41.891522 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:41.891470 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t5s5h\"" Jul 07 13:28:41.897338 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:41.897322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-thgtm" Jul 07 13:28:42.025869 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:42.025797 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-thgtm"] Jul 07 13:28:42.027944 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:42.027909 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa744534_a05e_4976_b40f_b08cb5967ae5.slice/crio-b5c7bfd1d840fd06ab9faa79ca91448cf10247fc4854c360ab581b5662e286a4 WatchSource:0}: Error finding container b5c7bfd1d840fd06ab9faa79ca91448cf10247fc4854c360ab581b5662e286a4: Status 404 returned error can't find the container with id b5c7bfd1d840fd06ab9faa79ca91448cf10247fc4854c360ab581b5662e286a4 Jul 07 13:28:42.171675 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:42.171642 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thgtm" event={"ID":"aa744534-a05e-4976-b40f-b08cb5967ae5","Type":"ContainerStarted","Data":"b5c7bfd1d840fd06ab9faa79ca91448cf10247fc4854c360ab581b5662e286a4"} Jul 07 13:28:43.577396 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.577357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:43.577835 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.577408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:43.580826 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.580794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 13:28:43.581859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.581840 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 13:28:43.591428 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.591403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccdf5162-4439-4058-90bb-89d7bd1d390d-original-pull-secret\") pod \"global-pull-secret-syncer-mnlfx\" (UID: \"ccdf5162-4439-4058-90bb-89d7bd1d390d\") " pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:43.591582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.591458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddaa8868-5ebe-483d-bd25-99a8aac38344-metrics-certs\") pod \"network-metrics-daemon-dtfwr\" (UID: \"ddaa8868-5ebe-483d-bd25-99a8aac38344\") " pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:43.678114 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.678082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:43.680918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.680873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6q8\" (UniqueName: \"kubernetes.io/projected/6533eafa-d765-49c6-829a-304cd44828a9-kube-api-access-mp6q8\") pod \"network-check-target-28spb\" (UID: \"6533eafa-d765-49c6-829a-304cd44828a9\") " pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:43.705260 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.705239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6stv\"" Jul 07 13:28:43.707317 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.707293 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mnlfx" Jul 07 13:28:43.712381 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.712360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfwr" Jul 07 13:28:43.915047 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.915014 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z824\"" Jul 07 13:28:43.922709 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:43.922687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:45.795323 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:45.795204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mnlfx"] Jul 07 13:28:45.798142 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:45.798119 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdf5162_4439_4058_90bb_89d7bd1d390d.slice/crio-b26bf2956f74ecda7d313c230bf5ec9c1832ea49f57fa47e13b35b6f67078e42 WatchSource:0}: Error finding container b26bf2956f74ecda7d313c230bf5ec9c1832ea49f57fa47e13b35b6f67078e42: Status 404 returned error can't find the container with id b26bf2956f74ecda7d313c230bf5ec9c1832ea49f57fa47e13b35b6f67078e42 Jul 07 13:28:46.013762 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.013737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtfwr"] Jul 07 13:28:46.014867 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.014848 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28spb"] Jul 07 13:28:46.015974 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:46.015952 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6533eafa_d765_49c6_829a_304cd44828a9.slice/crio-9755c824445514407d770b2c2588b51e993a414b23d380e20d2ec54c8e8dab08 WatchSource:0}: Error finding container 9755c824445514407d770b2c2588b51e993a414b23d380e20d2ec54c8e8dab08: Status 404 returned error can't find the container with id 9755c824445514407d770b2c2588b51e993a414b23d380e20d2ec54c8e8dab08 Jul 07 13:28:46.016599 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:46.016580 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddaa8868_5ebe_483d_bd25_99a8aac38344.slice/crio-5380743b54531b900ae1feea3346d140bf0c0b16cfe3d9029ade44a96183c43e WatchSource:0}: Error finding container 5380743b54531b900ae1feea3346d140bf0c0b16cfe3d9029ade44a96183c43e: Status 404 returned error can't find the container with id 5380743b54531b900ae1feea3346d140bf0c0b16cfe3d9029ade44a96183c43e Jul 07 13:28:46.187478 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.187442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfwr" event={"ID":"ddaa8868-5ebe-483d-bd25-99a8aac38344","Type":"ContainerStarted","Data":"5380743b54531b900ae1feea3346d140bf0c0b16cfe3d9029ade44a96183c43e"} Jul 07 13:28:46.188923 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.188897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28spb" event={"ID":"6533eafa-d765-49c6-829a-304cd44828a9","Type":"ContainerStarted","Data":"a8fdcc7dd7542ba2b07f7f39de684c63c6db611cc410e8b3dc3bee2f4a412b0e"} Jul 07 13:28:46.189049 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.188940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28spb" event={"ID":"6533eafa-d765-49c6-829a-304cd44828a9","Type":"ContainerStarted","Data":"9755c824445514407d770b2c2588b51e993a414b23d380e20d2ec54c8e8dab08"} Jul 07 13:28:46.189049 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.188983 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:28:46.190347 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.190327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thgtm" event={"ID":"aa744534-a05e-4976-b40f-b08cb5967ae5","Type":"ContainerStarted","Data":"8eb046cdb54deb64d4c484dd0bc2b30a56c5946820a10db8daa00d0866d9b38c"} Jul 07 13:28:46.191265 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.191248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnlfx" event={"ID":"ccdf5162-4439-4058-90bb-89d7bd1d390d","Type":"ContainerStarted","Data":"b26bf2956f74ecda7d313c230bf5ec9c1832ea49f57fa47e13b35b6f67078e42"} Jul 07 13:28:46.209846 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.209800 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-28spb" podStartSLOduration=67.209785845 podStartE2EDuration="1m7.209785845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:46.208710987 +0000 UTC m=+67.963121227" watchObservedRunningTime="2026-07-07 13:28:46.209785845 +0000 UTC m=+67.964196072" Jul 07 13:28:46.504437 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.504406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:46.507084 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.507058 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"image-registry-fc489dd9c-2qfw2\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:46.605715 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.605680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:46.605869 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.605723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:46.605930 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.605863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:46.605994 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.605977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:46.606422 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.606371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9f6acf-a05c-4334-b5fc-670fb00a5698-service-ca-bundle\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:46.608451 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.608432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9f6acf-a05c-4334-b5fc-670fb00a5698-metrics-certs\") pod \"router-default-7448b4689c-ctzmt\" (UID: \"4f9f6acf-a05c-4334-b5fc-670fb00a5698\") " pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:46.608578 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.608544 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c3b07c-ccf6-4743-aeb6-538acbc0f175-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-drl7h\" (UID: \"96c3b07c-ccf6-4743-aeb6-538acbc0f175\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:46.608645 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.608574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/31d159de-0ec9-4960-8847-c888e7910f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-6727q\" (UID: \"31d159de-0ec9-4960-8847-c888e7910f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:46.706429 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.706346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:46.708989 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.708955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fe4816a-6fed-44ce-8c7c-e2790197e7a8-metrics-tls\") pod \"dns-default-t7lt4\" (UID: \"8fe4816a-6fed-44ce-8c7c-e2790197e7a8\") " pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:46.744977 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.744952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mmkl7\"" Jul 07 13:28:46.752179 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.752150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:46.779429 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.779387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f6h9s\"" Jul 07 13:28:46.786925 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.786879 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:46.804312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.804295 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l5vp9\"" Jul 07 13:28:46.812401 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.812119 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" Jul 07 13:28:46.828809 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.828573 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n9rh9\"" Jul 07 13:28:46.835219 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.835189 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" Jul 07 13:28:46.897513 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.897282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rgbgq\"" Jul 07 13:28:46.903530 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.903392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:46.924617 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.924342 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:28:46.941155 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:46.941100 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45b3861_315b_4432_9a9c_26c2e3911a04.slice/crio-be9e4ae16d3a38fbe4da61602f34b8c96c041ac315aba7d87f1b5c17dfff25a5 WatchSource:0}: Error finding container be9e4ae16d3a38fbe4da61602f34b8c96c041ac315aba7d87f1b5c17dfff25a5: Status 404 returned error can't find the container with id be9e4ae16d3a38fbe4da61602f34b8c96c041ac315aba7d87f1b5c17dfff25a5 Jul 07 13:28:46.969592 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:46.969502 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7448b4689c-ctzmt"] Jul 07 13:28:47.002318 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.001877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q"] Jul 07 13:28:47.046724 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.046102 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h"] Jul 07 13:28:47.054047 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:47.054004 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c3b07c_ccf6_4743_aeb6_538acbc0f175.slice/crio-640bedff89b2ba294dfbb96b7fa9f7a2f5d414b48733e798e5fb9c5a0942f66e WatchSource:0}: Error finding container 640bedff89b2ba294dfbb96b7fa9f7a2f5d414b48733e798e5fb9c5a0942f66e: Status 404 returned error can't find the container with id 640bedff89b2ba294dfbb96b7fa9f7a2f5d414b48733e798e5fb9c5a0942f66e Jul 07 13:28:47.118031 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.117998 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t7lt4"] Jul 07 13:28:47.122294 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:28:47.122236 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe4816a_6fed_44ce_8c7c_e2790197e7a8.slice/crio-62da65e050c0335fefe181cbb8382f7ff1c63fe2c5b86b342390459e8235a2df WatchSource:0}: Error finding container 62da65e050c0335fefe181cbb8382f7ff1c63fe2c5b86b342390459e8235a2df: Status 404 returned error can't find the container with id 62da65e050c0335fefe181cbb8382f7ff1c63fe2c5b86b342390459e8235a2df Jul 07 13:28:47.204375 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.204272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thgtm" event={"ID":"aa744534-a05e-4976-b40f-b08cb5967ae5","Type":"ContainerStarted","Data":"b7b8f7a75eda9edd27d2f72ad6b04cd88a0292220f9adb68f9a1209f61d22987"} Jul 07 13:28:47.211016 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.210949 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" event={"ID":"31d159de-0ec9-4960-8847-c888e7910f3b","Type":"ContainerStarted","Data":"63ca412eecdd2f6e1fba71d7165f21085bf70ffa40cc1f1e2a657ce891bdcde9"} Jul 07 13:28:47.212870 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.212841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7lt4" event={"ID":"8fe4816a-6fed-44ce-8c7c-e2790197e7a8","Type":"ContainerStarted","Data":"62da65e050c0335fefe181cbb8382f7ff1c63fe2c5b86b342390459e8235a2df"} Jul 07 13:28:47.219835 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.219733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" event={"ID":"96c3b07c-ccf6-4743-aeb6-538acbc0f175","Type":"ContainerStarted","Data":"640bedff89b2ba294dfbb96b7fa9f7a2f5d414b48733e798e5fb9c5a0942f66e"} Jul 07 13:28:47.224122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.223277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" event={"ID":"b45b3861-315b-4432-9a9c-26c2e3911a04","Type":"ContainerStarted","Data":"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26"} Jul 07 13:28:47.224122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.223320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" event={"ID":"b45b3861-315b-4432-9a9c-26c2e3911a04","Type":"ContainerStarted","Data":"be9e4ae16d3a38fbe4da61602f34b8c96c041ac315aba7d87f1b5c17dfff25a5"} Jul 07 13:28:47.224122 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.224074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:28:47.227452 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.227376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7448b4689c-ctzmt" event={"ID":"4f9f6acf-a05c-4334-b5fc-670fb00a5698","Type":"ContainerStarted","Data":"1363f0b52dc5b8845ae9ab5a4c51cc753bdc15ecdaca4c8b9412ac038651c83a"} Jul 07 13:28:47.227452 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.227411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7448b4689c-ctzmt" event={"ID":"4f9f6acf-a05c-4334-b5fc-670fb00a5698","Type":"ContainerStarted","Data":"aeff2ce2e1c717cd315cdefa7c4e12df9b16c834a83aaed7559f96c1578203e3"} Jul 07 13:28:47.255998 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.255937 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" podStartSLOduration=68.255911704 podStartE2EDuration="1m8.255911704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:47.252944311 +0000 UTC m=+69.007354566" watchObservedRunningTime="2026-07-07 13:28:47.255911704 +0000 UTC m=+69.010321953" Jul 07 13:28:47.285306 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.285170 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7448b4689c-ctzmt" podStartSLOduration=47.285151546 podStartE2EDuration="47.285151546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:47.28417666 +0000 UTC m=+69.038586908" watchObservedRunningTime="2026-07-07 13:28:47.285151546 +0000 UTC m=+69.039561796" Jul 07 13:28:47.787762 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.787700 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:47.790785 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.790758 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:47.791412 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:47.791391 2565 scope.go:117] "RemoveContainer" containerID="18b86b3794074059e36ed5306ce2f60c8a1fa30481c9ed8cae2f7f0f5d0552ed" Jul 07 13:28:48.235264 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.235228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:28:48.235736 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.235344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" event={"ID":"2bfbeeb5-2f77-41ad-891b-9af9f80f359a","Type":"ContainerStarted","Data":"560577c178af849e1685e95fda849f2cfff4b76e97478307ce1c542a3c5f8680"} Jul 07 13:28:48.236607 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.236469 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:28:48.241527 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.240962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfwr" event={"ID":"ddaa8868-5ebe-483d-bd25-99a8aac38344","Type":"ContainerStarted","Data":"216f09a1fea6223379fb9c3bff40c227b463fc4731b2c3e32745641679e8bce6"} Jul 07 13:28:48.241527 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.241009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfwr" event={"ID":"ddaa8868-5ebe-483d-bd25-99a8aac38344","Type":"ContainerStarted","Data":"87a54fe6e332cb4bf8eafd9ac431bf5663163a126a72d0a0a421c5b80ecf77e3"} Jul 07 13:28:48.241839 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.241799 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:48.245269 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.245248 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7448b4689c-ctzmt" Jul 07 13:28:48.257076 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.257016 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podStartSLOduration=38.618152568 podStartE2EDuration="48.257000125s" totalImagesPullingTime="9.638847557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:48.256338199 +0000 UTC m=+70.010748449" watchObservedRunningTime="2026-07-07 13:28:48.257000125 +0000 UTC m=+70.011410375" Jul 07 13:28:48.303255 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:48.303198 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtfwr" podStartSLOduration=67.564361629 podStartE2EDuration="1m9.303176194s" totalImagesPullingTime="1.738814565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:48.278054724 +0000 UTC m=+70.032464973" watchObservedRunningTime="2026-07-07 13:28:48.303176194 +0000 UTC m=+70.057586422" Jul 07 13:28:49.236637 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:49.236599 2565 patch_prober.go:28] interesting pod/console-operator-68b757fb67-d5dmw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:28:49.237104 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:49.236664 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podUID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 07 13:28:50.245986 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:50.245942 2565 patch_prober.go:28] interesting pod/console-operator-68b757fb67-d5dmw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:28:50.246452 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:50.246023 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" podUID="2bfbeeb5-2f77-41ad-891b-9af9f80f359a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 07 13:28:54.265472 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.265370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thgtm" event={"ID":"aa744534-a05e-4976-b40f-b08cb5967ae5","Type":"ContainerStarted","Data":"cefdc40d91504d292147b62db932a5f4a794dd3b133533befa8f6d92139ffaf9"} Jul 07 13:28:54.267055 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.267020 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mnlfx" event={"ID":"ccdf5162-4439-4058-90bb-89d7bd1d390d","Type":"ContainerStarted","Data":"9ba76db01411babf7365327dbe919539612380bbf3519411649d4a493ae059da"} Jul 07 13:28:54.268831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.268803 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" event={"ID":"31d159de-0ec9-4960-8847-c888e7910f3b","Type":"ContainerStarted","Data":"96ffb81f3d660ea8adcf954bc3bfae3a5e897d6063daf79886bc82c204ec7566"} Jul 07 13:28:54.268961 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.268853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" event={"ID":"31d159de-0ec9-4960-8847-c888e7910f3b","Type":"ContainerStarted","Data":"e52050a3847ad794db233632608e622317323d3bb638cf03b4dfde919e04bf07"} Jul 07 13:28:54.270863 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.270836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7lt4" event={"ID":"8fe4816a-6fed-44ce-8c7c-e2790197e7a8","Type":"ContainerStarted","Data":"47f1e405d212c6f05c98b487fd358f1e68df34a7588e80eb695afa8e856237ac"} Jul 07 13:28:54.270978 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.270885 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t7lt4" event={"ID":"8fe4816a-6fed-44ce-8c7c-e2790197e7a8","Type":"ContainerStarted","Data":"3a5b81f810dc0660fc8ef8f4d5a459760485aee4a833aae65d4b24e8b9c79774"} Jul 07 13:28:54.271043 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.270973 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t7lt4" Jul 07 13:28:54.272277 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.272254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" event={"ID":"96c3b07c-ccf6-4743-aeb6-538acbc0f175","Type":"ContainerStarted","Data":"c2df316f65d960fdcccc6f5c66ed789bf54a0555e756ef148f253016f6b92fb5"} Jul 07 13:28:54.288612 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.288403 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-thgtm" podStartSLOduration=17.759536135 podStartE2EDuration="29.288386799s" totalImagesPullingTime="11.528850664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:28:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:54.287544179 +0000 UTC m=+76.041954428" watchObservedRunningTime="2026-07-07 13:28:54.288386799 +0000 UTC m=+76.042797047" Jul 07 13:28:54.309635 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.309579 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-6727q" podStartSLOduration=47.691323679 podStartE2EDuration="54.309561708s" totalImagesPullingTime="6.618238029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:54.308778101 +0000 UTC m=+76.063188349" watchObservedRunningTime="2026-07-07 13:28:54.309561708 +0000 UTC m=+76.063971954" Jul 07 13:28:54.330609 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.330552 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-drl7h" podStartSLOduration=47.70048013 podStartE2EDuration="54.330536699s" totalImagesPullingTime="6.630056569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:54.329555965 +0000 UTC m=+76.083966213" watchObservedRunningTime="2026-07-07 13:28:54.330536699 +0000 UTC m=+76.084946947" Jul 07 13:28:54.366979 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.366932 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t7lt4" podStartSLOduration=33.802940675 podStartE2EDuration="40.366918493s" totalImagesPullingTime="6.563977818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:54.350767072 +0000 UTC m=+76.105177322" watchObservedRunningTime="2026-07-07 13:28:54.366918493 +0000 UTC m=+76.121328740" Jul 07 13:28:54.367290 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:54.367269 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mnlfx" podStartSLOduration=67.465866295 podStartE2EDuration="1m15.367264883s" totalImagesPullingTime="7.901398588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:54.3666189 +0000 UTC m=+76.121029171" watchObservedRunningTime="2026-07-07 13:28:54.367264883 +0000 UTC m=+76.121675131" Jul 07 13:28:59.249925 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:28:59.249784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-d5dmw" Jul 07 13:29:00.359583 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.359551 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:00.392091 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.392067 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:00.392247 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.392157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.396934 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.396910 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 13:29:00.397234 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.397219 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 13:29:00.397521 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.397505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 13:29:00.411648 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.411627 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 13:29:00.412784 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.412761 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 13:29:00.412883 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.412808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4l4hj\"" Jul 07 13:29:00.412883 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.412819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 13:29:00.412883 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.412835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 13:29:00.514235 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.514411 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514248 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.514411 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.514411 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.514616 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.514616 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.514454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9q2r\" (UniqueName: \"kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.615765 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9q2r\" (UniqueName: \"kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.615765 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.615848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616430 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.616395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616719 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.616446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.616719 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.616545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.618401 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.618381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.618401 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.618384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.625674 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.625650 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9q2r\" (UniqueName: \"kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r\") pod \"console-594489697c-f4gq2\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.701879 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.701848 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:00.868541 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:00.868517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:00.870763 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:29:00.870741 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a2c40f_295a_4b1a_af63_110596b7d0fb.slice/crio-fddd6decdbc91f08267802ec83dd648a3c12e7c055470105a71c4c3749fd078b WatchSource:0}: Error finding container fddd6decdbc91f08267802ec83dd648a3c12e7c055470105a71c4c3749fd078b: Status 404 returned error can't find the container with id fddd6decdbc91f08267802ec83dd648a3c12e7c055470105a71c4c3749fd078b Jul 07 13:29:01.298349 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:01.298319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594489697c-f4gq2" event={"ID":"21a2c40f-295a-4b1a-af63-110596b7d0fb","Type":"ContainerStarted","Data":"fddd6decdbc91f08267802ec83dd648a3c12e7c055470105a71c4c3749fd078b"} Jul 07 13:29:04.278851 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:04.278778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t7lt4" Jul 07 13:29:04.312100 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:04.312067 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594489697c-f4gq2" event={"ID":"21a2c40f-295a-4b1a-af63-110596b7d0fb","Type":"ContainerStarted","Data":"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079"} Jul 07 13:29:04.337440 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:04.337383 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-594489697c-f4gq2" podStartSLOduration=1.271591943 podStartE2EDuration="4.337361386s" totalImagesPullingTime="3.065769443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:04.336543721 +0000 UTC m=+86.090953970" watchObservedRunningTime="2026-07-07 13:29:04.337361386 +0000 UTC m=+86.091771635" Jul 07 13:29:06.756222 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.756185 2565 patch_prober.go:28] interesting pod/image-registry-fc489dd9c-2qfw2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 13:29:06.756598 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.756239 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 13:29:06.902399 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.902368 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gl4ql"] Jul 07 13:29:06.905002 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.904985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:06.908608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.908586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 13:29:06.909922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.909903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 13:29:06.909922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.909913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 13:29:06.910081 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.909910 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6z2kr\"" Jul 07 13:29:06.910081 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:06.909909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 13:29:07.067979 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.067895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.067979 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.067929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqsz\" (UniqueName: \"kubernetes.io/projected/0c63576c-8535-498e-bc2b-61896ea4bee3-kube-api-access-nqqsz\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-metrics-client-ca\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-accelerators-collector-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-wtmp\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068152 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-root\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068311 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-textfile\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068311 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-tls\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.068311 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.068269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-sys\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169501 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-wtmp\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-root\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-textfile\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-tls\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-sys\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-root\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqsz\" (UniqueName: \"kubernetes.io/projected/0c63576c-8535-498e-bc2b-61896ea4bee3-kube-api-access-nqqsz\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-sys\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-wtmp\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-metrics-client-ca\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-accelerators-collector-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.169943 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.169907 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-textfile\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.170528 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.170507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-metrics-client-ca\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.170645 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.170612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-accelerators-collector-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.172109 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.172086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.172327 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.172305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c63576c-8535-498e-bc2b-61896ea4bee3-node-exporter-tls\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.179076 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.179051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqsz\" (UniqueName: \"kubernetes.io/projected/0c63576c-8535-498e-bc2b-61896ea4bee3-kube-api-access-nqqsz\") pod \"node-exporter-gl4ql\" (UID: \"0c63576c-8535-498e-bc2b-61896ea4bee3\") " pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.214772 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.214740 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gl4ql" Jul 07 13:29:07.224721 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:29:07.224696 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c63576c_8535_498e_bc2b_61896ea4bee3.slice/crio-b7450219ccde694f751823b0a611e89dd8003003c020a4eab0590c7416d07fef WatchSource:0}: Error finding container b7450219ccde694f751823b0a611e89dd8003003c020a4eab0590c7416d07fef: Status 404 returned error can't find the container with id b7450219ccde694f751823b0a611e89dd8003003c020a4eab0590c7416d07fef Jul 07 13:29:07.323429 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.323352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gl4ql" event={"ID":"0c63576c-8535-498e-bc2b-61896ea4bee3","Type":"ContainerStarted","Data":"b7450219ccde694f751823b0a611e89dd8003003c020a4eab0590c7416d07fef"} Jul 07 13:29:07.911362 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.911326 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:29:07.914528 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.914477 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:07.917290 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.917269 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p7l79\"" Jul 07 13:29:07.917568 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.917554 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 13:29:07.918049 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918017 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 13:29:07.918134 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918073 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 13:29:07.918188 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 13:29:07.918324 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918308 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 13:29:07.918405 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918391 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 13:29:07.918455 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918410 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 13:29:07.918614 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918598 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 13:29:07.918674 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.918604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 13:29:07.931510 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:07.931468 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:29:08.078070 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078256 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfhm\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.078553 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.078429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179766 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179766 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfhm\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.179988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.179992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.180423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.180020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.180423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.180066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.180423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.180339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.181104 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:29:08.180769 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 07 13:29:08.181104 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:29:08.180840 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls podName:e43d3c01-9d53-45c2-9c7a-31cf12155652 nodeName:}" failed. No retries permitted until 2026-07-07 13:29:08.680821383 +0000 UTC m=+90.435231622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652") : secret "alertmanager-main-tls" not found Jul 07 13:29:08.181104 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.180940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.181691 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.181667 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.183769 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.183721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.184668 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.184111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.184668 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.184255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.184668 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.184506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.184668 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.184622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.184914 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.184665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.185418 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.185398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.185844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.185821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.189531 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.189469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfhm\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.684947 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.684873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.687288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.687260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.828187 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.828156 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:29:08.830473 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.830450 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75cc857f9c-w6hl8"] Jul 07 13:29:08.832822 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.832807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.835905 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.835876 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 13:29:08.836039 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.835966 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 13:29:08.836212 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.836191 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nmfpl\"" Jul 07 13:29:08.836554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.836530 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 13:29:08.836682 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.836660 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1uggsguo4oi3k\"" Jul 07 13:29:08.836749 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.836720 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 13:29:08.837262 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.837243 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 13:29:08.846585 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.846563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cc857f9c-w6hl8"] Jul 07 13:29:08.968830 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.968804 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:29:08.970281 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:29:08.970261 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43d3c01_9d53_45c2_9c7a_31cf12155652.slice/crio-b96962a76169dac1dc080714631c8163aa06a6eb2f44abc3372ca1dddc5877c9 WatchSource:0}: Error finding container b96962a76169dac1dc080714631c8163aa06a6eb2f44abc3372ca1dddc5877c9: Status 404 returned error can't find the container with id b96962a76169dac1dc080714631c8163aa06a6eb2f44abc3372ca1dddc5877c9 Jul 07 13:29:08.987805 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqqgq\" (UniqueName: \"kubernetes.io/projected/0b18d614-cef1-4c4c-87ba-b2748dd486a8-kube-api-access-gqqgq\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.987891 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b18d614-cef1-4c4c-87ba-b2748dd486a8-metrics-client-ca\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.987891 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.987984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.987984 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.988062 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.987982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.988062 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.988012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:08.988062 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:08.988033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-grpc-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089101 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqqgq\" (UniqueName: \"kubernetes.io/projected/0b18d614-cef1-4c4c-87ba-b2748dd486a8-kube-api-access-gqqgq\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b18d614-cef1-4c4c-87ba-b2748dd486a8-metrics-client-ca\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089243 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089413 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089464 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089542 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089542 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089535 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-grpc-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.089900 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.089873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b18d614-cef1-4c4c-87ba-b2748dd486a8-metrics-client-ca\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.091949 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.091912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.092088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.092073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-grpc-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.092229 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.092210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.092585 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.092567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.092636 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.092612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.092700 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.092680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b18d614-cef1-4c4c-87ba-b2748dd486a8-secret-thanos-querier-tls\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.097512 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.097468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqqgq\" (UniqueName: \"kubernetes.io/projected/0b18d614-cef1-4c4c-87ba-b2748dd486a8-kube-api-access-gqqgq\") pod \"thanos-querier-75cc857f9c-w6hl8\" (UID: \"0b18d614-cef1-4c4c-87ba-b2748dd486a8\") " pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.142200 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.142179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:09.250655 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.250627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:29:09.285357 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.285334 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75cc857f9c-w6hl8"] Jul 07 13:29:09.288012 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:29:09.287979 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b18d614_cef1_4c4c_87ba_b2748dd486a8.slice/crio-e212957f41d0e06719b56bf2af7ecffb566d4b3f5f8cb5287d15d40c43b185a8 WatchSource:0}: Error finding container e212957f41d0e06719b56bf2af7ecffb566d4b3f5f8cb5287d15d40c43b185a8: Status 404 returned error can't find the container with id e212957f41d0e06719b56bf2af7ecffb566d4b3f5f8cb5287d15d40c43b185a8 Jul 07 13:29:09.331338 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.331305 2565 generic.go:356] "Generic (PLEG): container finished" podID="0c63576c-8535-498e-bc2b-61896ea4bee3" containerID="fe7453e51b4bea69b901a8610fa32e351ad68c1eef3233d4d98242ebd7107fb4" exitCode=0 Jul 07 13:29:09.331500 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.331381 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gl4ql" event={"ID":"0c63576c-8535-498e-bc2b-61896ea4bee3","Type":"ContainerDied","Data":"fe7453e51b4bea69b901a8610fa32e351ad68c1eef3233d4d98242ebd7107fb4"} Jul 07 13:29:09.332704 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.332681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"e212957f41d0e06719b56bf2af7ecffb566d4b3f5f8cb5287d15d40c43b185a8"} Jul 07 13:29:09.334057 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:09.334033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"b96962a76169dac1dc080714631c8163aa06a6eb2f44abc3372ca1dddc5877c9"} Jul 07 13:29:10.340841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.340521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gl4ql" event={"ID":"0c63576c-8535-498e-bc2b-61896ea4bee3","Type":"ContainerStarted","Data":"191776c28270896c65b8eaa646c4e9a018abed8a06c5b5f55bb99b2b67e725b2"} Jul 07 13:29:10.340841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.340593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gl4ql" event={"ID":"0c63576c-8535-498e-bc2b-61896ea4bee3","Type":"ContainerStarted","Data":"da5033e7179befb8f32f1c150bca868c87f35af3c28b2bfcc41ce61c7d719cee"} Jul 07 13:29:10.342211 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.342185 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f" exitCode=0 Jul 07 13:29:10.342341 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.342262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f"} Jul 07 13:29:10.387596 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.387548 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gl4ql" podStartSLOduration=3.245864191 podStartE2EDuration="4.387528597s" totalImagesPullingTime="1.067824099s" totalInitContainerRuntime="73.840307ms" isStatefulPod=true podCreationTimestamp="2026-07-07 13:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:10.387378114 +0000 UTC m=+92.141788361" watchObservedRunningTime="2026-07-07 13:29:10.387528597 +0000 UTC m=+92.141938845" Jul 07 13:29:10.702749 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.702711 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:10.702888 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.702793 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:10.708139 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:10.708114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:11.352610 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:11.352577 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:12.354133 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.354041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6"} Jul 07 13:29:12.354133 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.354107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3"} Jul 07 13:29:12.354561 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.354148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d"} Jul 07 13:29:12.354561 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.354180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf"} Jul 07 13:29:12.354561 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.354204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335"} Jul 07 13:29:12.357313 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.357277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"b830306aaf0b9303727e292b814a58bc7defb464898fbf010a9066ddf8a1a749"} Jul 07 13:29:12.357441 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.357352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"b2e00f7d15f68460a43708f8c1cfa1bf8859ea620ea3427dd04037e1eeb0d6e8"} Jul 07 13:29:12.357441 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:12.357393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"ccf3332a57372aa41016db650f54597a7c1f5e022eb205f6e7f67200be9a41ed"} Jul 07 13:29:13.135402 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.135373 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:29:13.368359 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.368318 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"cdd4c883a9d4ed8460198d5f0b4d650d72d8d7a0caa406a185cc3ca4090aa802"} Jul 07 13:29:13.368830 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.368429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"4a0775fad1a99a4508f85b39e429f0aff876f37ba07c47bd28f85c0a78ebc706"} Jul 07 13:29:13.368830 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.368467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:13.368830 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.368528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" event={"ID":"0b18d614-cef1-4c4c-87ba-b2748dd486a8","Type":"ContainerStarted","Data":"ed6df2f4be6fea133a58bdddaa965bdf04842315a5122cd2f8bdbd1db801173e"} Jul 07 13:29:13.371697 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.371676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerStarted","Data":"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68"} Jul 07 13:29:13.396030 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.395953 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" podStartSLOduration=2.067318891 podStartE2EDuration="5.395941344s" totalImagesPullingTime="3.328622453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:29:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:13.395240659 +0000 UTC m=+95.149650909" watchObservedRunningTime="2026-07-07 13:29:13.395941344 +0000 UTC m=+95.150351591" Jul 07 13:29:13.427056 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:13.426995 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.14396392 podStartE2EDuration="6.426981185s" totalImagesPullingTime="3.27288592s" totalInitContainerRuntime="10.131345ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:29:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:13.425934369 +0000 UTC m=+95.180344617" watchObservedRunningTime="2026-07-07 13:29:13.426981185 +0000 UTC m=+95.181391434" Jul 07 13:29:15.039070 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.039038 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:29:15.042366 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.042349 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.051198 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.051178 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 13:29:15.058782 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.058763 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:29:15.149886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.149852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.149886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.149885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.150088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.149910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.150088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.149987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.150088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.150060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.150182 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.150088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.150182 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.150113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rcb\" (UniqueName: \"kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251063 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rcb\" (UniqueName: \"kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251427 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251427 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251427 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251860 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.251985 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251949 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.252217 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.251988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.252217 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.252096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.253953 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.253929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.254044 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.253979 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.260580 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.260554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rcb\" (UniqueName: \"kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb\") pod \"console-5485847bcc-248z6\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.352611 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.352552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:15.485170 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:15.485036 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:29:15.487939 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:29:15.487906 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd473bd74_7c65_4423_a7b8_e3805dfe993d.slice/crio-638f3ddae1f2a4ff85582d9734928f3458006e13c928a9272dbba2f618590fdd WatchSource:0}: Error finding container 638f3ddae1f2a4ff85582d9734928f3458006e13c928a9272dbba2f618590fdd: Status 404 returned error can't find the container with id 638f3ddae1f2a4ff85582d9734928f3458006e13c928a9272dbba2f618590fdd Jul 07 13:29:16.387560 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:16.387519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5485847bcc-248z6" event={"ID":"d473bd74-7c65-4423-a7b8-e3805dfe993d","Type":"ContainerStarted","Data":"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b"} Jul 07 13:29:16.388056 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:16.387604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5485847bcc-248z6" event={"ID":"d473bd74-7c65-4423-a7b8-e3805dfe993d","Type":"ContainerStarted","Data":"638f3ddae1f2a4ff85582d9734928f3458006e13c928a9272dbba2f618590fdd"} Jul 07 13:29:16.407461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:16.407410 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5485847bcc-248z6" podStartSLOduration=1.4073925 podStartE2EDuration="1.4073925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:29:16.405716555 +0000 UTC m=+98.160126804" watchObservedRunningTime="2026-07-07 13:29:16.4073925 +0000 UTC m=+98.161802748" Jul 07 13:29:17.229955 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:17.229918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-28spb" Jul 07 13:29:19.382448 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:19.382420 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75cc857f9c-w6hl8" Jul 07 13:29:25.353047 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:25.353012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:25.353420 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:25.353068 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:25.357775 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:25.357753 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:25.427069 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:25.427043 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:29:25.482297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:25.482263 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:31.450903 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:31.450868 2565 generic.go:356] "Generic (PLEG): container finished" podID="d9d271ef-f34e-4d37-94c0-b282e06dbb1c" containerID="0a324d800688de08b2c4e58c81a86e2c078a0c8cf26407de9ba6e50b24157349" exitCode=0 Jul 07 13:29:31.451301 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:31.450935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" event={"ID":"d9d271ef-f34e-4d37-94c0-b282e06dbb1c","Type":"ContainerDied","Data":"0a324d800688de08b2c4e58c81a86e2c078a0c8cf26407de9ba6e50b24157349"} Jul 07 13:29:31.451301 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:31.451240 2565 scope.go:117] "RemoveContainer" containerID="0a324d800688de08b2c4e58c81a86e2c078a0c8cf26407de9ba6e50b24157349" Jul 07 13:29:32.456884 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:32.456851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-h7hkn" event={"ID":"d9d271ef-f34e-4d37-94c0-b282e06dbb1c","Type":"ContainerStarted","Data":"7be3481154d0f68e495736e668e532b3fd763e191a63b1aee2db1552933646d6"} Jul 07 13:29:38.159805 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.159740 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerName="registry" containerID="cri-o://115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26" gracePeriod=30 Jul 07 13:29:38.418722 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.418666 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:29:38.487660 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.487633 2565 generic.go:356] "Generic (PLEG): container finished" podID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerID="115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26" exitCode=0 Jul 07 13:29:38.487787 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.487676 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" Jul 07 13:29:38.487787 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.487713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" event={"ID":"b45b3861-315b-4432-9a9c-26c2e3911a04","Type":"ContainerDied","Data":"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26"} Jul 07 13:29:38.487787 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.487763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc489dd9c-2qfw2" event={"ID":"b45b3861-315b-4432-9a9c-26c2e3911a04","Type":"ContainerDied","Data":"be9e4ae16d3a38fbe4da61602f34b8c96c041ac315aba7d87f1b5c17dfff25a5"} Jul 07 13:29:38.487887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.487790 2565 scope.go:117] "RemoveContainer" containerID="115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26" Jul 07 13:29:38.496123 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.496107 2565 scope.go:117] "RemoveContainer" containerID="115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26" Jul 07 13:29:38.496362 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:29:38.496344 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26\": container with ID starting with 115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26 not found: ID does not exist" containerID="115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26" Jul 07 13:29:38.496425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.496372 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26"} err="failed to get container status \"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26\": rpc error: code = NotFound desc = could not find container \"115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26\": container with ID starting with 115c687e7bb9138ff7e56edaa9d2ec64e6f0fbdc0f4c68a949a9c12c9830cf26 not found: ID does not exist" Jul 07 13:29:38.535780 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535761 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.535861 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535810 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.535861 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535837 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.535861 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535855 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.535957 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535886 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.535957 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.536077 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.535973 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.536554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.536258 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:38.536554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.536101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws99l\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l\") pod \"b45b3861-315b-4432-9a9c-26c2e3911a04\" (UID: \"b45b3861-315b-4432-9a9c-26c2e3911a04\") " Jul 07 13:29:38.536554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.536404 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:38.536926 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.536907 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-certificates\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.537080 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.537045 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45b3861-315b-4432-9a9c-26c2e3911a04-trusted-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.538838 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.538813 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:38.538952 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.538928 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:38.538952 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.538930 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:38.539200 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.539177 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:38.539347 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.539329 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l" (OuterVolumeSpecName: "kube-api-access-ws99l") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "kube-api-access-ws99l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:38.544554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.544527 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b45b3861-315b-4432-9a9c-26c2e3911a04" (UID: "b45b3861-315b-4432-9a9c-26c2e3911a04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:38.637604 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637584 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-image-registry-private-configuration\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.637604 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637604 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-bound-sa-token\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.637720 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637614 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws99l\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-kube-api-access-ws99l\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.637720 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637623 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b45b3861-315b-4432-9a9c-26c2e3911a04-registry-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.637720 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637632 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b45b3861-315b-4432-9a9c-26c2e3911a04-installation-pull-secrets\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.637720 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.637640 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b45b3861-315b-4432-9a9c-26c2e3911a04-ca-trust-extracted\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:38.813660 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.811378 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:29:38.815706 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:38.815679 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc489dd9c-2qfw2"] Jul 07 13:29:40.796973 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:40.796938 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" path="/var/lib/kubelet/pods/b45b3861-315b-4432-9a9c-26c2e3911a04/volumes" Jul 07 13:29:42.505164 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:42.505126 2565 generic.go:356] "Generic (PLEG): container finished" podID="92b3304f-5537-4aa1-aaa3-3ee4298a8da6" containerID="5dfb007976d440e2c2359adbae63f8aae38939a9f8d7a6309e674db293d20f58" exitCode=0 Jul 07 13:29:42.505529 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:42.505207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" event={"ID":"92b3304f-5537-4aa1-aaa3-3ee4298a8da6","Type":"ContainerDied","Data":"5dfb007976d440e2c2359adbae63f8aae38939a9f8d7a6309e674db293d20f58"} Jul 07 13:29:42.505529 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:42.505512 2565 scope.go:117] "RemoveContainer" containerID="5dfb007976d440e2c2359adbae63f8aae38939a9f8d7a6309e674db293d20f58" Jul 07 13:29:43.512027 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:43.511992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-q5l4n" event={"ID":"92b3304f-5537-4aa1-aaa3-3ee4298a8da6","Type":"ContainerStarted","Data":"554785c15cd07c9782d8778f9292ecc435c4302347e9092e8fac1110aa4a9af4"} Jul 07 13:29:50.506429 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.506383 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-594489697c-f4gq2" podUID="21a2c40f-295a-4b1a-af63-110596b7d0fb" containerName="console" containerID="cri-o://5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079" gracePeriod=15 Jul 07 13:29:50.747462 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.747437 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:50.839271 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839195 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9q2r\" (UniqueName: \"kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839271 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839309 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839339 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839361 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839405 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca\") pod \"21a2c40f-295a-4b1a-af63-110596b7d0fb\" (UID: \"21a2c40f-295a-4b1a-af63-110596b7d0fb\") " Jul 07 13:29:50.839842 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839754 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config" (OuterVolumeSpecName: "console-config") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:50.839929 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839843 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:50.839990 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.839921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:50.841699 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.841670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:50.841809 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.841730 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:50.841809 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.841733 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r" (OuterVolumeSpecName: "kube-api-access-m9q2r") pod "21a2c40f-295a-4b1a-af63-110596b7d0fb" (UID: "21a2c40f-295a-4b1a-af63-110596b7d0fb"). InnerVolumeSpecName "kube-api-access-m9q2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:50.940402 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940370 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:50.940402 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940394 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-oauth-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:50.940402 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940404 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21a2c40f-295a-4b1a-af63-110596b7d0fb-console-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:50.940654 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940418 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:50.940654 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940436 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9q2r\" (UniqueName: \"kubernetes.io/projected/21a2c40f-295a-4b1a-af63-110596b7d0fb-kube-api-access-m9q2r\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:50.940654 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:50.940444 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21a2c40f-295a-4b1a-af63-110596b7d0fb-oauth-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:29:51.545535 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.545502 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5bb81ef-dc31-4066-baba-8a89135f44d2" containerID="8dc8030170ccf81d403227fcef5ee1f0ca3a622c3952b37becb59fc9e9b4d4f5" exitCode=0 Jul 07 13:29:51.545930 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.545556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" event={"ID":"d5bb81ef-dc31-4066-baba-8a89135f44d2","Type":"ContainerDied","Data":"8dc8030170ccf81d403227fcef5ee1f0ca3a622c3952b37becb59fc9e9b4d4f5"} Jul 07 13:29:51.545930 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.545908 2565 scope.go:117] "RemoveContainer" containerID="8dc8030170ccf81d403227fcef5ee1f0ca3a622c3952b37becb59fc9e9b4d4f5" Jul 07 13:29:51.546862 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.546839 2565 generic.go:356] "Generic (PLEG): container finished" podID="21a2c40f-295a-4b1a-af63-110596b7d0fb" containerID="5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079" exitCode=0 Jul 07 13:29:51.546926 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.546894 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594489697c-f4gq2" Jul 07 13:29:51.546926 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.546916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594489697c-f4gq2" event={"ID":"21a2c40f-295a-4b1a-af63-110596b7d0fb","Type":"ContainerDied","Data":"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079"} Jul 07 13:29:51.547007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.546951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594489697c-f4gq2" event={"ID":"21a2c40f-295a-4b1a-af63-110596b7d0fb","Type":"ContainerDied","Data":"fddd6decdbc91f08267802ec83dd648a3c12e7c055470105a71c4c3749fd078b"} Jul 07 13:29:51.547007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.546976 2565 scope.go:117] "RemoveContainer" containerID="5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079" Jul 07 13:29:51.556856 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.556839 2565 scope.go:117] "RemoveContainer" containerID="5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079" Jul 07 13:29:51.557100 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:29:51.557083 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079\": container with ID starting with 5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079 not found: ID does not exist" containerID="5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079" Jul 07 13:29:51.557176 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.557108 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079"} err="failed to get container status \"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079\": rpc error: code = NotFound desc = could not find container \"5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079\": container with ID starting with 5a5e1a6f04bd4cd109d9a298d22ad3e1c0ef16b1eaf8bf73fafcd56f806f3079 not found: ID does not exist" Jul 07 13:29:51.583109 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.583084 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:51.588295 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:51.588272 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594489697c-f4gq2"] Jul 07 13:29:52.557215 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:52.557172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-srfxv" event={"ID":"d5bb81ef-dc31-4066-baba-8a89135f44d2","Type":"ContainerStarted","Data":"c539d6e9fb1a34cef3fd3b67390f1cbeb69697a39ee40c867d74b235d32fa876"} Jul 07 13:29:52.796777 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:29:52.796733 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a2c40f-295a-4b1a-af63-110596b7d0fb" path="/var/lib/kubelet/pods/21a2c40f-295a-4b1a-af63-110596b7d0fb/volumes" Jul 07 13:30:27.172961 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.172925 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173344 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="alertmanager" containerID="cri-o://d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" gracePeriod=120 Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173353 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-metric" containerID="cri-o://c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" gracePeriod=120 Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173369 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-web" containerID="cri-o://63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" gracePeriod=120 Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173405 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy" containerID="cri-o://7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" gracePeriod=120 Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173416 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="config-reloader" containerID="cri-o://a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" gracePeriod=120 Jul 07 13:30:27.173600 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.173420 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="prom-label-proxy" containerID="cri-o://162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" gracePeriod=120 Jul 07 13:30:27.699841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699804 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" exitCode=0 Jul 07 13:30:27.699841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699828 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" exitCode=0 Jul 07 13:30:27.699841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699839 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" exitCode=0 Jul 07 13:30:27.699841 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699846 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" exitCode=0 Jul 07 13:30:27.700098 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68"} Jul 07 13:30:27.700098 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3"} Jul 07 13:30:27.700098 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf"} Jul 07 13:30:27.700098 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:27.699987 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335"} Jul 07 13:30:28.419587 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.419564 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.443773 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443754 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.443887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443781 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.443887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443803 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.443887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443826 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.443887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443860 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.443976 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.444012 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.444041 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.444068 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444570 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.444101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.444570 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.444151 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsfhm\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm\") pod \"e43d3c01-9d53-45c2-9c7a-31cf12155652\" (UID: \"e43d3c01-9d53-45c2-9c7a-31cf12155652\") " Jul 07 13:30:28.445239 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.445204 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:30:28.445349 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.445232 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:30:28.445560 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.445534 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:28.447464 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.447435 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.447687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.447662 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out" (OuterVolumeSpecName: "config-out") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:28.447687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.447666 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm" (OuterVolumeSpecName: "kube-api-access-jsfhm") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "kube-api-access-jsfhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:30:28.447857 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.447753 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.448018 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.447991 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume" (OuterVolumeSpecName: "config-volume") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.448113 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.448065 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.448628 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.448608 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:30:28.448772 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.448756 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.451939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.451920 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.461274 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.461252 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config" (OuterVolumeSpecName: "web-config") pod "e43d3c01-9d53-45c2-9c7a-31cf12155652" (UID: "e43d3c01-9d53-45c2-9c7a-31cf12155652"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545436 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-metrics-client-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545461 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-main-db\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545472 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsfhm\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-kube-api-access-jsfhm\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545481 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-web-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545502 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-out\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545509 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-main-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545518 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545527 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545536 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e43d3c01-9d53-45c2-9c7a-31cf12155652-tls-assets\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545544 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e43d3c01-9d53-45c2-9c7a-31cf12155652-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545552 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-cluster-tls-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545554 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545561 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.545989 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.545570 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e43d3c01-9d53-45c2-9c7a-31cf12155652-config-volume\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:30:28.706286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706252 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" exitCode=0 Jul 07 13:30:28.706286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706284 2565 generic.go:356] "Generic (PLEG): container finished" podID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerID="63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" exitCode=0 Jul 07 13:30:28.706469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6"} Jul 07 13:30:28.706469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706344 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.706469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d"} Jul 07 13:30:28.706469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e43d3c01-9d53-45c2-9c7a-31cf12155652","Type":"ContainerDied","Data":"b96962a76169dac1dc080714631c8163aa06a6eb2f44abc3372ca1dddc5877c9"} Jul 07 13:30:28.706469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.706468 2565 scope.go:117] "RemoveContainer" containerID="162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" Jul 07 13:30:28.715068 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.715048 2565 scope.go:117] "RemoveContainer" containerID="c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" Jul 07 13:30:28.722213 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.722193 2565 scope.go:117] "RemoveContainer" containerID="7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" Jul 07 13:30:28.730503 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.730470 2565 scope.go:117] "RemoveContainer" containerID="63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" Jul 07 13:30:28.736622 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.736600 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:28.737993 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.737962 2565 scope.go:117] "RemoveContainer" containerID="a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" Jul 07 13:30:28.743971 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.743948 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:28.746242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.746228 2565 scope.go:117] "RemoveContainer" containerID="d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" Jul 07 13:30:28.753467 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.753452 2565 scope.go:117] "RemoveContainer" containerID="e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f" Jul 07 13:30:28.760034 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760021 2565 scope.go:117] "RemoveContainer" containerID="162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" Jul 07 13:30:28.760261 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.760244 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68\": container with ID starting with 162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68 not found: ID does not exist" containerID="162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" Jul 07 13:30:28.760305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760270 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68"} err="failed to get container status \"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68\": rpc error: code = NotFound desc = could not find container \"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68\": container with ID starting with 162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68 not found: ID does not exist" Jul 07 13:30:28.760305 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760290 2565 scope.go:117] "RemoveContainer" containerID="c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" Jul 07 13:30:28.760571 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.760552 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6\": container with ID starting with c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6 not found: ID does not exist" containerID="c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" Jul 07 13:30:28.760627 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760575 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6"} err="failed to get container status \"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6\": rpc error: code = NotFound desc = could not find container \"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6\": container with ID starting with c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6 not found: ID does not exist" Jul 07 13:30:28.760627 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760592 2565 scope.go:117] "RemoveContainer" containerID="7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" Jul 07 13:30:28.760826 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.760811 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3\": container with ID starting with 7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3 not found: ID does not exist" containerID="7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" Jul 07 13:30:28.760860 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760830 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3"} err="failed to get container status \"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3\": rpc error: code = NotFound desc = could not find container \"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3\": container with ID starting with 7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3 not found: ID does not exist" Jul 07 13:30:28.760860 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.760843 2565 scope.go:117] "RemoveContainer" containerID="63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" Jul 07 13:30:28.761067 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.761050 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d\": container with ID starting with 63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d not found: ID does not exist" containerID="63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" Jul 07 13:30:28.761123 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761069 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d"} err="failed to get container status \"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d\": rpc error: code = NotFound desc = could not find container \"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d\": container with ID starting with 63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d not found: ID does not exist" Jul 07 13:30:28.761123 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761082 2565 scope.go:117] "RemoveContainer" containerID="a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" Jul 07 13:30:28.761300 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.761285 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf\": container with ID starting with a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf not found: ID does not exist" containerID="a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" Jul 07 13:30:28.761339 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761303 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf"} err="failed to get container status \"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf\": rpc error: code = NotFound desc = could not find container \"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf\": container with ID starting with a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf not found: ID does not exist" Jul 07 13:30:28.761339 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761315 2565 scope.go:117] "RemoveContainer" containerID="d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" Jul 07 13:30:28.761556 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.761535 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335\": container with ID starting with d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335 not found: ID does not exist" containerID="d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" Jul 07 13:30:28.761608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761563 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335"} err="failed to get container status \"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335\": rpc error: code = NotFound desc = could not find container \"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335\": container with ID starting with d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335 not found: ID does not exist" Jul 07 13:30:28.761608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761579 2565 scope.go:117] "RemoveContainer" containerID="e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f" Jul 07 13:30:28.761769 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:30:28.761754 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f\": container with ID starting with e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f not found: ID does not exist" containerID="e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f" Jul 07 13:30:28.761816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761771 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f"} err="failed to get container status \"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f\": rpc error: code = NotFound desc = could not find container \"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f\": container with ID starting with e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f not found: ID does not exist" Jul 07 13:30:28.761816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761783 2565 scope.go:117] "RemoveContainer" containerID="162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68" Jul 07 13:30:28.761945 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761928 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68"} err="failed to get container status \"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68\": rpc error: code = NotFound desc = could not find container \"162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68\": container with ID starting with 162dc9e6ee6ea8226722b6e575cc37731d228b74c3d19fb0ac41acdee0339e68 not found: ID does not exist" Jul 07 13:30:28.761989 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.761944 2565 scope.go:117] "RemoveContainer" containerID="c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6" Jul 07 13:30:28.762174 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762157 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6"} err="failed to get container status \"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6\": rpc error: code = NotFound desc = could not find container \"c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6\": container with ID starting with c46b4384eaeae06f8ab6749be0a8a68e88376204a33df0e412beb933f01f0ed6 not found: ID does not exist" Jul 07 13:30:28.762219 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762175 2565 scope.go:117] "RemoveContainer" containerID="7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3" Jul 07 13:30:28.762431 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762414 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3"} err="failed to get container status \"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3\": rpc error: code = NotFound desc = could not find container \"7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3\": container with ID starting with 7ed0f3b2339cbf84a49f8fd045fa691861a7e97233735ea30ff88f9a7cec6dd3 not found: ID does not exist" Jul 07 13:30:28.762480 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762431 2565 scope.go:117] "RemoveContainer" containerID="63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d" Jul 07 13:30:28.762661 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762643 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d"} err="failed to get container status \"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d\": rpc error: code = NotFound desc = could not find container \"63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d\": container with ID starting with 63432cc6cb6fabb8ade67a109ae8e281ec72a601b9d83645087d1287bb56077d not found: ID does not exist" Jul 07 13:30:28.762699 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762662 2565 scope.go:117] "RemoveContainer" containerID="a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf" Jul 07 13:30:28.762871 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762854 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf"} err="failed to get container status \"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf\": rpc error: code = NotFound desc = could not find container \"a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf\": container with ID starting with a0d5c3446ce8bd792e475b4786215c4bd0aee7842036e753a30b3bf93ffdbebf not found: ID does not exist" Jul 07 13:30:28.762871 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.762869 2565 scope.go:117] "RemoveContainer" containerID="d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335" Jul 07 13:30:28.763060 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.763044 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335"} err="failed to get container status \"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335\": rpc error: code = NotFound desc = could not find container \"d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335\": container with ID starting with d45f4ac95c147bbaae43c65924a396cec3c14f39c77e00fbad1093cc8c6b8335 not found: ID does not exist" Jul 07 13:30:28.763060 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.763060 2565 scope.go:117] "RemoveContainer" containerID="e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f" Jul 07 13:30:28.763248 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.763233 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f"} err="failed to get container status \"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f\": rpc error: code = NotFound desc = could not find container \"e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f\": container with ID starting with e1f250eaee1327861b9305ee88076666f233d6f19c7cc13bab3355ca1db1ff2f not found: ID does not exist" Jul 07 13:30:28.787265 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787241 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:28.787576 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787560 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="init-config-reloader" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787579 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="init-config-reloader" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787598 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a2c40f-295a-4b1a-af63-110596b7d0fb" containerName="console" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787606 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a2c40f-295a-4b1a-af63-110596b7d0fb" containerName="console" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787615 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-web" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787623 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-web" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787632 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy" Jul 07 13:30:28.787646 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787641 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787653 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="alertmanager" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787661 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="alertmanager" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787678 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-metric" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787687 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-metric" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787704 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="prom-label-proxy" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787712 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="prom-label-proxy" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787721 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerName="registry" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787730 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerName="registry" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787741 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="config-reloader" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787750 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="config-reloader" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787823 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="config-reloader" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787833 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787842 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-metric" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787852 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45b3861-315b-4432-9a9c-26c2e3911a04" containerName="registry" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787861 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="kube-rbac-proxy-web" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787873 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="prom-label-proxy" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787883 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a2c40f-295a-4b1a-af63-110596b7d0fb" containerName="console" Jul 07 13:30:28.787980 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.787890 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" containerName="alertmanager" Jul 07 13:30:28.792717 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.792700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.798622 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.798568 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e43d3c01-9d53-45c2-9c7a-31cf12155652" path="/var/lib/kubelet/pods/e43d3c01-9d53-45c2-9c7a-31cf12155652/volumes" Jul 07 13:30:28.801101 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.801084 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 13:30:28.801663 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.801647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p7l79\"" Jul 07 13:30:28.801751 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.801647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 13:30:28.803259 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.803241 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 13:30:28.803344 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.803304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 13:30:28.804735 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.804720 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 13:30:28.804868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.804853 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 13:30:28.807270 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.807255 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 13:30:28.808356 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.808341 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 13:30:28.812093 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.812067 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 13:30:28.829522 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.829502 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:28.847424 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-out\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847518 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847518 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-web-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x8k2\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-kube-api-access-4x8k2\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.847868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.848032 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.847910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-out\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-web-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x8k2\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-kube-api-access-4x8k2\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.948813 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.948741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.949371 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.949295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.951284 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.951259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.951406 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.951392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-out\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.951864 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.951840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.952423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.951995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.952423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.952153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.952423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.952276 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-web-config\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.952423 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.952383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.952696 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.952551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.953233 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.953214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.953544 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.953525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:28.958826 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:28.958807 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x8k2\" (UniqueName: \"kubernetes.io/projected/87563211-aa5e-4bfd-9b92-06af5ac8f9a7-kube-api-access-4x8k2\") pod \"alertmanager-main-0\" (UID: \"87563211-aa5e-4bfd-9b92-06af5ac8f9a7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:29.102859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:29.102779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 13:30:29.248760 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:29.248731 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 13:30:29.251966 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:30:29.251940 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87563211_aa5e_4bfd_9b92_06af5ac8f9a7.slice/crio-66de153d201283f838e52487d32a1021a24be00eeccfd1a7e350c8ea5a3acb29 WatchSource:0}: Error finding container 66de153d201283f838e52487d32a1021a24be00eeccfd1a7e350c8ea5a3acb29: Status 404 returned error can't find the container with id 66de153d201283f838e52487d32a1021a24be00eeccfd1a7e350c8ea5a3acb29 Jul 07 13:30:29.712105 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:29.712069 2565 generic.go:356] "Generic (PLEG): container finished" podID="87563211-aa5e-4bfd-9b92-06af5ac8f9a7" containerID="0f7ee4267d3ec4557da35765781f7eedee279562eeebde1bd8c141d88694c2ee" exitCode=0 Jul 07 13:30:29.712597 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:29.712125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerDied","Data":"0f7ee4267d3ec4557da35765781f7eedee279562eeebde1bd8c141d88694c2ee"} Jul 07 13:30:29.712597 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:29.712172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"66de153d201283f838e52487d32a1021a24be00eeccfd1a7e350c8ea5a3acb29"} Jul 07 13:30:30.720632 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"3f14bccd83eb61bf9490ee3fda93e66b6e7ddfabc08cec26c9bdbb828c19b2b5"} Jul 07 13:30:30.721061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"a5e7baa0f4561c561f8e8728de741445ea9da8cea6eafa989c171ec5f2b59862"} Jul 07 13:30:30.721061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"61151c316eda98c61710d8dac67b53dacabbbb114901078e544a49a60430e93d"} Jul 07 13:30:30.721061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"ed1fdcb1a5b3ef96260d2c527b3221c93e18b9f4d98e987f1b20e2bd7069c4ab"} Jul 07 13:30:30.721061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720737 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"42157c512b7f27aba9b9964a6f46570f5d93a75dce6ece7160a66296fe4a114f"} Jul 07 13:30:30.721061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.720765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"87563211-aa5e-4bfd-9b92-06af5ac8f9a7","Type":"ContainerStarted","Data":"1cb46e85f19d29dd3166825ba826936cae7fc4d3bc9db9b15cfbfe00ad29735e"} Jul 07 13:30:30.754033 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:30.753984 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.734345597 podStartE2EDuration="2.75396442s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.618823ms" isStatefulPod=false podCreationTimestamp="2026-07-07 13:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:30.752751517 +0000 UTC m=+172.507161765" watchObservedRunningTime="2026-07-07 13:30:30.75396442 +0000 UTC m=+172.508374669" Jul 07 13:30:31.213119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.213085 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cc5684db6-ktwpw"] Jul 07 13:30:31.218058 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.218016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.221077 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.221051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 13:30:31.222410 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.222385 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 13:30:31.222559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.222508 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 13:30:31.222559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.222519 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-75pdh\"" Jul 07 13:30:31.222559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.222531 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 13:30:31.223425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.223407 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 13:30:31.227821 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.227804 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 13:30:31.241608 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.241587 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cc5684db6-ktwpw"] Jul 07 13:30:31.269031 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.268998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269208 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269208 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269208 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-federate-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269208 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmnb\" (UniqueName: \"kubernetes.io/projected/ab72430e-39ed-443e-b1d2-7334375dd0bf-kube-api-access-xwmnb\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.269374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.269269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-metrics-client-ca\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369680 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-metrics-client-ca\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369680 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-federate-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.369939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.369873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmnb\" (UniqueName: \"kubernetes.io/projected/ab72430e-39ed-443e-b1d2-7334375dd0bf-kube-api-access-xwmnb\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.370524 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.370472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-serving-certs-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.370703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.370652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-metrics-client-ca\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.370951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.370928 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.372346 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.372324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.372574 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.372547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-telemeter-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.372965 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.372942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-secret-telemeter-client\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.373030 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.373013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ab72430e-39ed-443e-b1d2-7334375dd0bf-federate-client-tls\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.379788 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.379763 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmnb\" (UniqueName: \"kubernetes.io/projected/ab72430e-39ed-443e-b1d2-7334375dd0bf-kube-api-access-xwmnb\") pod \"telemeter-client-7cc5684db6-ktwpw\" (UID: \"ab72430e-39ed-443e-b1d2-7334375dd0bf\") " pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.529957 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.529893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" Jul 07 13:30:31.681724 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.681700 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cc5684db6-ktwpw"] Jul 07 13:30:31.684168 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:30:31.684141 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab72430e_39ed_443e_b1d2_7334375dd0bf.slice/crio-cbe8f200614ad6e5ce9e9bd0eb6666de861fec136dab727d28eef065a2a72cec WatchSource:0}: Error finding container cbe8f200614ad6e5ce9e9bd0eb6666de861fec136dab727d28eef065a2a72cec: Status 404 returned error can't find the container with id cbe8f200614ad6e5ce9e9bd0eb6666de861fec136dab727d28eef065a2a72cec Jul 07 13:30:31.727288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:31.727253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" event={"ID":"ab72430e-39ed-443e-b1d2-7334375dd0bf","Type":"ContainerStarted","Data":"cbe8f200614ad6e5ce9e9bd0eb6666de861fec136dab727d28eef065a2a72cec"} Jul 07 13:30:34.742415 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:34.742373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" event={"ID":"ab72430e-39ed-443e-b1d2-7334375dd0bf","Type":"ContainerStarted","Data":"a2170dc77e9ad8752b9ecb98d4f04f22596c12dcec370424220bfd5646264765"} Jul 07 13:30:34.742825 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:34.742446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" event={"ID":"ab72430e-39ed-443e-b1d2-7334375dd0bf","Type":"ContainerStarted","Data":"8a963eee82d599289cc939df71ad0eaae5403e58c2edcc64ef0fbc8d8b9639a1"} Jul 07 13:30:34.742825 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:34.742473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" event={"ID":"ab72430e-39ed-443e-b1d2-7334375dd0bf","Type":"ContainerStarted","Data":"3bb0cbac4b0aa17a92aaa3e5e602a6412c99e1ee0b797ae9c998c76e90c0f1ee"} Jul 07 13:30:34.767108 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:34.767059 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cc5684db6-ktwpw" podStartSLOduration=1.67031674 podStartE2EDuration="3.767043775s" totalImagesPullingTime="2.096727035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:34.765725568 +0000 UTC m=+176.520135816" watchObservedRunningTime="2026-07-07 13:30:34.767043775 +0000 UTC m=+176.521454033" Jul 07 13:30:35.679805 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.679768 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:30:35.683403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.683382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.695381 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.695355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:30:35.807768 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.807739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.807791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.807843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.807963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.808002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.808053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97zwx\" (UniqueName: \"kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.808238 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.808163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909242 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97zwx\" (UniqueName: \"kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.909444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.909366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.910049 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.910013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.910161 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.910064 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.910232 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.910212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.910332 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.910307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.911969 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.911947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.912057 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.912001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.918543 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.918526 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97zwx\" (UniqueName: \"kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx\") pod \"console-bcbcf9c8c-xgwlg\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:35.994107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:35.994048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:36.127179 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:36.127156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:30:36.129755 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:30:36.129729 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28dc0ff8_773c_4cb7_bbc0_23c8735a5330.slice/crio-42ddcfa3368a504369443c8867ef394f6a4eaf3a7fccb637537fb99217b67111 WatchSource:0}: Error finding container 42ddcfa3368a504369443c8867ef394f6a4eaf3a7fccb637537fb99217b67111: Status 404 returned error can't find the container with id 42ddcfa3368a504369443c8867ef394f6a4eaf3a7fccb637537fb99217b67111 Jul 07 13:30:36.753040 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:36.753006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcf9c8c-xgwlg" event={"ID":"28dc0ff8-773c-4cb7-bbc0-23c8735a5330","Type":"ContainerStarted","Data":"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27"} Jul 07 13:30:36.753223 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:36.753052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcf9c8c-xgwlg" event={"ID":"28dc0ff8-773c-4cb7-bbc0-23c8735a5330","Type":"ContainerStarted","Data":"42ddcfa3368a504369443c8867ef394f6a4eaf3a7fccb637537fb99217b67111"} Jul 07 13:30:36.772628 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:36.772581 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcbcf9c8c-xgwlg" podStartSLOduration=1.7725661750000001 podStartE2EDuration="1.772566175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:36.770550383 +0000 UTC m=+178.524960631" watchObservedRunningTime="2026-07-07 13:30:36.772566175 +0000 UTC m=+178.526976470" Jul 07 13:30:45.995146 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:45.995100 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:45.995561 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:45.995195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:46.000006 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:45.999983 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:46.797414 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:46.797381 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:30:46.853310 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:30:46.853273 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:31:11.875978 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:11.875937 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5485847bcc-248z6" podUID="d473bd74-7c65-4423-a7b8-e3805dfe993d" containerName="console" containerID="cri-o://4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b" gracePeriod=15 Jul 07 13:31:12.130530 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.130453 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:31:12.218966 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.218926 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.218994 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219018 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219036 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8rcb\" (UniqueName: \"kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219062 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219077 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219114 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle\") pod \"d473bd74-7c65-4423-a7b8-e3805dfe993d\" (UID: \"d473bd74-7c65-4423-a7b8-e3805dfe993d\") " Jul 07 13:31:12.219471 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219412 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:31:12.219635 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219601 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:31:12.219745 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219605 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config" (OuterVolumeSpecName: "console-config") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:31:12.219745 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.219662 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:31:12.221571 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.221540 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:31:12.221831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.221811 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:31:12.221887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.221869 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb" (OuterVolumeSpecName: "kube-api-access-c8rcb") pod "d473bd74-7c65-4423-a7b8-e3805dfe993d" (UID: "d473bd74-7c65-4423-a7b8-e3805dfe993d"). InnerVolumeSpecName "kube-api-access-c8rcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:31:12.319922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319890 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.319922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319917 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-oauth-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.319922 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319928 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8rcb\" (UniqueName: \"kubernetes.io/projected/d473bd74-7c65-4423-a7b8-e3805dfe993d-kube-api-access-c8rcb\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.320145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319937 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.320145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319946 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d473bd74-7c65-4423-a7b8-e3805dfe993d-console-oauth-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.320145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319955 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-trusted-ca-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.320145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.319963 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d473bd74-7c65-4423-a7b8-e3805dfe993d-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:31:12.893948 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.893918 2565 generic.go:356] "Generic (PLEG): container finished" podID="d473bd74-7c65-4423-a7b8-e3805dfe993d" containerID="4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b" exitCode=0 Jul 07 13:31:12.894342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.893963 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5485847bcc-248z6" Jul 07 13:31:12.894342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.893981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5485847bcc-248z6" event={"ID":"d473bd74-7c65-4423-a7b8-e3805dfe993d","Type":"ContainerDied","Data":"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b"} Jul 07 13:31:12.894342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.894021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5485847bcc-248z6" event={"ID":"d473bd74-7c65-4423-a7b8-e3805dfe993d","Type":"ContainerDied","Data":"638f3ddae1f2a4ff85582d9734928f3458006e13c928a9272dbba2f618590fdd"} Jul 07 13:31:12.894342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.894042 2565 scope.go:117] "RemoveContainer" containerID="4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b" Jul 07 13:31:12.902064 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.902048 2565 scope.go:117] "RemoveContainer" containerID="4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b" Jul 07 13:31:12.902327 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:31:12.902307 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b\": container with ID starting with 4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b not found: ID does not exist" containerID="4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b" Jul 07 13:31:12.902433 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.902338 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b"} err="failed to get container status \"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b\": rpc error: code = NotFound desc = could not find container \"4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b\": container with ID starting with 4b4ad043d679b5f7d74057f7f08e24489797130e8fa11ade2357265fd9323b6b not found: ID does not exist" Jul 07 13:31:12.911025 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.911005 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:31:12.914584 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:12.914566 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5485847bcc-248z6"] Jul 07 13:31:14.796348 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:14.796315 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d473bd74-7c65-4423-a7b8-e3805dfe993d" path="/var/lib/kubelet/pods/d473bd74-7c65-4423-a7b8-e3805dfe993d/volumes" Jul 07 13:31:41.719758 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.719720 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:31:41.720225 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.720111 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d473bd74-7c65-4423-a7b8-e3805dfe993d" containerName="console" Jul 07 13:31:41.720225 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.720126 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d473bd74-7c65-4423-a7b8-e3805dfe993d" containerName="console" Jul 07 13:31:41.720225 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.720181 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d473bd74-7c65-4423-a7b8-e3805dfe993d" containerName="console" Jul 07 13:31:41.722715 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.722696 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.738232 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.738207 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:31:41.867690 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.867911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.867911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nktd4\" (UniqueName: \"kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.867911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.867911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.867911 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.868181 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.867934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969058 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nktd4\" (UniqueName: \"kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.969263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.970012 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969951 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.970012 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.970012 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.970012 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.969997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.972260 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.972244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.972396 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.972375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:41.981907 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:41.981884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nktd4\" (UniqueName: \"kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4\") pod \"console-84758d96b7-tzrxc\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:42.032421 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:42.032395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:42.173106 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:42.173083 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:31:42.174829 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:31:42.174801 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c60f296_6491_42c6_ab32_f44a3cceea59.slice/crio-c9589be0100a928c42ea675d6989db7d708b0b059de5ee4cba6a765ddaa3ca14 WatchSource:0}: Error finding container c9589be0100a928c42ea675d6989db7d708b0b059de5ee4cba6a765ddaa3ca14: Status 404 returned error can't find the container with id c9589be0100a928c42ea675d6989db7d708b0b059de5ee4cba6a765ddaa3ca14 Jul 07 13:31:43.013050 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:43.013012 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84758d96b7-tzrxc" event={"ID":"1c60f296-6491-42c6-ab32-f44a3cceea59","Type":"ContainerStarted","Data":"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d"} Jul 07 13:31:43.013540 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:43.013070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84758d96b7-tzrxc" event={"ID":"1c60f296-6491-42c6-ab32-f44a3cceea59","Type":"ContainerStarted","Data":"c9589be0100a928c42ea675d6989db7d708b0b059de5ee4cba6a765ddaa3ca14"} Jul 07 13:31:43.038901 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:43.038849 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84758d96b7-tzrxc" podStartSLOduration=2.038829893 podStartE2EDuration="2.038829893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:31:43.037295842 +0000 UTC m=+244.791706093" watchObservedRunningTime="2026-07-07 13:31:43.038829893 +0000 UTC m=+244.793240140" Jul 07 13:31:52.033390 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:52.033350 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:52.033878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:52.033418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:52.037855 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:52.037833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:52.056175 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:52.056154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:31:52.113704 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:31:52.113667 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:32:17.137522 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.137417 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bcbcf9c8c-xgwlg" podUID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" containerName="console" containerID="cri-o://f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27" gracePeriod=15 Jul 07 13:32:17.376460 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.376438 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:32:17.448828 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448752 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.448828 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448790 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449024 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448828 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449024 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448858 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449024 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448943 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449024 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.448977 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97zwx\" (UniqueName: \"kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449024 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.449005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle\") pod \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\" (UID: \"28dc0ff8-773c-4cb7-bbc0-23c8735a5330\") " Jul 07 13:32:17.449294 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.449268 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config" (OuterVolumeSpecName: "console-config") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:32:17.449349 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.449321 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:32:17.449406 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.449379 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca" (OuterVolumeSpecName: "service-ca") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:32:17.449684 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.449623 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:32:17.451084 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.451052 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:32:17.451084 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.451071 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:32:17.451274 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.451247 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx" (OuterVolumeSpecName: "kube-api-access-97zwx") pod "28dc0ff8-773c-4cb7-bbc0-23c8735a5330" (UID: "28dc0ff8-773c-4cb7-bbc0-23c8735a5330"). InnerVolumeSpecName "kube-api-access-97zwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:32:17.550042 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550003 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550042 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550037 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97zwx\" (UniqueName: \"kubernetes.io/projected/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-kube-api-access-97zwx\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550042 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550047 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-trusted-ca-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550042 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550056 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550269 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550065 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-oauth-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550269 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550073 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-oauth-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:17.550269 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:17.550083 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28dc0ff8-773c-4cb7-bbc0-23c8735a5330-console-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:32:18.157782 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.157746 2565 generic.go:356] "Generic (PLEG): container finished" podID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" containerID="f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27" exitCode=0 Jul 07 13:32:18.158199 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.157798 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbcf9c8c-xgwlg" Jul 07 13:32:18.158199 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.157828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcf9c8c-xgwlg" event={"ID":"28dc0ff8-773c-4cb7-bbc0-23c8735a5330","Type":"ContainerDied","Data":"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27"} Jul 07 13:32:18.158199 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.157891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbcf9c8c-xgwlg" event={"ID":"28dc0ff8-773c-4cb7-bbc0-23c8735a5330","Type":"ContainerDied","Data":"42ddcfa3368a504369443c8867ef394f6a4eaf3a7fccb637537fb99217b67111"} Jul 07 13:32:18.158199 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.157917 2565 scope.go:117] "RemoveContainer" containerID="f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27" Jul 07 13:32:18.167267 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.167243 2565 scope.go:117] "RemoveContainer" containerID="f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27" Jul 07 13:32:18.167589 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:32:18.167570 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27\": container with ID starting with f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27 not found: ID does not exist" containerID="f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27" Jul 07 13:32:18.167654 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.167598 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27"} err="failed to get container status \"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27\": rpc error: code = NotFound desc = could not find container \"f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27\": container with ID starting with f890674a83007a053234390381bc74b03856167948adb95f334bf5d6e8ed4b27 not found: ID does not exist" Jul 07 13:32:18.186144 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.186119 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:32:18.191100 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.191077 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcbcf9c8c-xgwlg"] Jul 07 13:32:18.796097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:18.796065 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" path="/var/lib/kubelet/pods/28dc0ff8-773c-4cb7-bbc0-23c8735a5330/volumes" Jul 07 13:32:38.636107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:38.636080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:32:38.640913 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:38.640893 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:32:38.647703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:38.647684 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 13:32:42.311045 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.311013 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc"] Jul 07 13:32:42.312389 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.311364 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" containerName="console" Jul 07 13:32:42.312389 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.311377 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" containerName="console" Jul 07 13:32:42.312389 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.311444 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="28dc0ff8-773c-4cb7-bbc0-23c8735a5330" containerName="console" Jul 07 13:32:42.313468 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.313452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.316450 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.316430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:32:42.317406 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.317389 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:32:42.317510 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.317406 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hvzgn\"" Jul 07 13:32:42.323706 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.323682 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc"] Jul 07 13:32:42.454367 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.454332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6grn\" (UniqueName: \"kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.454518 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.454373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.454518 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.454432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.555192 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.555163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6grn\" (UniqueName: \"kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.555312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.555197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.555312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.555223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.555615 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.555595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.555658 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.555603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.572378 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.572310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6grn\" (UniqueName: \"kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.623446 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.623415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:32:42.755822 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.755752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc"] Jul 07 13:32:42.757897 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:32:42.757862 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee46fd4_6a43_4463_bbe2_5dd857c8d999.slice/crio-bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2 WatchSource:0}: Error finding container bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2: Status 404 returned error can't find the container with id bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2 Jul 07 13:32:42.759893 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:42.759872 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:32:43.261863 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:43.261820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" event={"ID":"1ee46fd4-6a43-4463-bbe2-5dd857c8d999","Type":"ContainerStarted","Data":"bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2"} Jul 07 13:32:51.300310 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:51.300212 2565 generic.go:356] "Generic (PLEG): container finished" podID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerID="a32887b910b7f0aa923a360d40a9eb4d30a9b879ce75b33975fd071a92469fc5" exitCode=0 Jul 07 13:32:51.300753 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:51.300311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" event={"ID":"1ee46fd4-6a43-4463-bbe2-5dd857c8d999","Type":"ContainerDied","Data":"a32887b910b7f0aa923a360d40a9eb4d30a9b879ce75b33975fd071a92469fc5"} Jul 07 13:32:54.315648 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:54.315611 2565 generic.go:356] "Generic (PLEG): container finished" podID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerID="8a40aea502f8861560374c44663f7c29afbb7f84afa003ca45cb3fd7432ab019" exitCode=0 Jul 07 13:32:54.316085 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:32:54.315691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" event={"ID":"1ee46fd4-6a43-4463-bbe2-5dd857c8d999","Type":"ContainerDied","Data":"8a40aea502f8861560374c44663f7c29afbb7f84afa003ca45cb3fd7432ab019"} Jul 07 13:33:03.358403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:03.358364 2565 generic.go:356] "Generic (PLEG): container finished" podID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerID="7dca161864d04bd1825681b64c9c62384a4b122b79269a60c5ccb4de38aaa9ea" exitCode=0 Jul 07 13:33:03.358763 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:03.358452 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" event={"ID":"1ee46fd4-6a43-4463-bbe2-5dd857c8d999","Type":"ContainerDied","Data":"7dca161864d04bd1825681b64c9c62384a4b122b79269a60c5ccb4de38aaa9ea"} Jul 07 13:33:04.530869 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.530845 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:33:04.549125 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.549101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle\") pod \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " Jul 07 13:33:04.549253 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.549157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6grn\" (UniqueName: \"kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn\") pod \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " Jul 07 13:33:04.549253 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.549187 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util\") pod \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\" (UID: \"1ee46fd4-6a43-4463-bbe2-5dd857c8d999\") " Jul 07 13:33:04.549848 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.549820 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle" (OuterVolumeSpecName: "bundle") pod "1ee46fd4-6a43-4463-bbe2-5dd857c8d999" (UID: "1ee46fd4-6a43-4463-bbe2-5dd857c8d999"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:04.551909 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.551877 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn" (OuterVolumeSpecName: "kube-api-access-w6grn") pod "1ee46fd4-6a43-4463-bbe2-5dd857c8d999" (UID: "1ee46fd4-6a43-4463-bbe2-5dd857c8d999"). InnerVolumeSpecName "kube-api-access-w6grn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:33:04.554735 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.554710 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util" (OuterVolumeSpecName: "util") pod "1ee46fd4-6a43-4463-bbe2-5dd857c8d999" (UID: "1ee46fd4-6a43-4463-bbe2-5dd857c8d999"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:04.650596 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.650570 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:04.650596 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.650596 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6grn\" (UniqueName: \"kubernetes.io/projected/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-kube-api-access-w6grn\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:04.650755 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:04.650606 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ee46fd4-6a43-4463-bbe2-5dd857c8d999-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:05.368056 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:05.368028 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" Jul 07 13:33:05.368056 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:05.368047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406xjpc" event={"ID":"1ee46fd4-6a43-4463-bbe2-5dd857c8d999","Type":"ContainerDied","Data":"bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2"} Jul 07 13:33:05.368257 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:05.368093 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf610e536639281a393ac18c8f4d75bd9dc604b9b2d09b8aa2b3f0a1765e1fe2" Jul 07 13:33:10.806463 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806428 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5"] Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806751 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="extract" Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806763 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="extract" Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806773 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="pull" Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806779 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="pull" Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806798 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="util" Jul 07 13:33:10.806816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806803 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="util" Jul 07 13:33:10.807011 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.806854 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee46fd4-6a43-4463-bbe2-5dd857c8d999" containerName="extract" Jul 07 13:33:10.808738 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.808722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:10.813834 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.813807 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:33:10.813834 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.813810 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j8ngx\"" Jul 07 13:33:10.814083 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.813849 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 13:33:10.827005 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.826974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5"] Jul 07 13:33:10.903021 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.902994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtc5l\" (UniqueName: \"kubernetes.io/projected/2c00e2d3-2f71-4af0-80b8-a15328220856-kube-api-access-qtc5l\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:10.903127 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:10.903027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c00e2d3-2f71-4af0-80b8-a15328220856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.004169 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.004131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtc5l\" (UniqueName: \"kubernetes.io/projected/2c00e2d3-2f71-4af0-80b8-a15328220856-kube-api-access-qtc5l\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.004169 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.004175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c00e2d3-2f71-4af0-80b8-a15328220856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.004510 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.004473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c00e2d3-2f71-4af0-80b8-a15328220856-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.014107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.014082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtc5l\" (UniqueName: \"kubernetes.io/projected/2c00e2d3-2f71-4af0-80b8-a15328220856-kube-api-access-qtc5l\") pod \"cert-manager-operator-controller-manager-55c444bf86-jd4l5\" (UID: \"2c00e2d3-2f71-4af0-80b8-a15328220856\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.117625 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.117571 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" Jul 07 13:33:11.250156 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.250063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5"] Jul 07 13:33:11.252759 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:11.252729 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c00e2d3_2f71_4af0_80b8_a15328220856.slice/crio-cfffddf9ba40ffc9b0ea501e376a665076fc19b810a3bcaed61e3684c5f09958 WatchSource:0}: Error finding container cfffddf9ba40ffc9b0ea501e376a665076fc19b810a3bcaed61e3684c5f09958: Status 404 returned error can't find the container with id cfffddf9ba40ffc9b0ea501e376a665076fc19b810a3bcaed61e3684c5f09958 Jul 07 13:33:11.396729 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:11.396699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" event={"ID":"2c00e2d3-2f71-4af0-80b8-a15328220856","Type":"ContainerStarted","Data":"cfffddf9ba40ffc9b0ea501e376a665076fc19b810a3bcaed61e3684c5f09958"} Jul 07 13:33:13.409642 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:13.409600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" event={"ID":"2c00e2d3-2f71-4af0-80b8-a15328220856","Type":"ContainerStarted","Data":"79c742af97db5e88ce69e3102ed8d1d27e27e4a79f9a65fe775871e70678edc8"} Jul 07 13:33:13.433457 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:13.433396 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jd4l5" podStartSLOduration=1.874978156 podStartE2EDuration="3.433374711s" totalImagesPullingTime="1.558396555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:33:13.430714437 +0000 UTC m=+335.185124687" watchObservedRunningTime="2026-07-07 13:33:13.433374711 +0000 UTC m=+335.187784964" Jul 07 13:33:14.358838 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.358802 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck"] Jul 07 13:33:14.361426 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.361409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.365852 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.365826 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:33:14.366221 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.366203 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:33:14.366312 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.366207 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hvzgn\"" Jul 07 13:33:14.376645 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.376622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck"] Jul 07 13:33:14.432444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.432410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.432844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.432451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjb67\" (UniqueName: \"kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.432844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.432541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.533336 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.533307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.533469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.533344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjb67\" (UniqueName: \"kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.533469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.533382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.533780 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.533758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.533850 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.533782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.550319 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.550291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjb67\" (UniqueName: \"kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.671044 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.671016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:14.813831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:14.813805 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck"] Jul 07 13:33:14.814894 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:14.814864 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9571f6_a596_4652_9191_57452fa72417.slice/crio-1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47 WatchSource:0}: Error finding container 1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47: Status 404 returned error can't find the container with id 1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47 Jul 07 13:33:15.419532 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.419474 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9571f6-a596-4652-9191-57452fa72417" containerID="8fb788c9adf915c1eb6c7076b5b4190889d86f42445e9e52f061abc407da848c" exitCode=0 Jul 07 13:33:15.419684 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.419539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerDied","Data":"8fb788c9adf915c1eb6c7076b5b4190889d86f42445e9e52f061abc407da848c"} Jul 07 13:33:15.419684 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.419589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerStarted","Data":"1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47"} Jul 07 13:33:15.620988 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.620956 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2cm72"] Jul 07 13:33:15.623088 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.623073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.628259 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.628211 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 13:33:15.628595 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.628569 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 13:33:15.628702 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.628684 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z7vp5\"" Jul 07 13:33:15.640666 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.640645 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2cm72"] Jul 07 13:33:15.744445 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.744364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.744445 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.744416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qqf9\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-kube-api-access-4qqf9\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.845244 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.845216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.845427 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.845270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qqf9\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-kube-api-access-4qqf9\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.865766 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.865737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.866647 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.866630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qqf9\" (UniqueName: \"kubernetes.io/projected/c354e9c4-7ee1-4701-9b44-ba34b82e2504-kube-api-access-4qqf9\") pod \"cert-manager-webhook-6486ffd997-2cm72\" (UID: \"c354e9c4-7ee1-4701-9b44-ba34b82e2504\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:15.949053 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:15.949022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:16.087163 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.087136 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2cm72"] Jul 07 13:33:16.089613 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:16.089583 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc354e9c4_7ee1_4701_9b44_ba34b82e2504.slice/crio-436d2bea45ae95e8aeadc13cc4dd78199d47adc732dc445c10abe9b1be51acaa WatchSource:0}: Error finding container 436d2bea45ae95e8aeadc13cc4dd78199d47adc732dc445c10abe9b1be51acaa: Status 404 returned error can't find the container with id 436d2bea45ae95e8aeadc13cc4dd78199d47adc732dc445c10abe9b1be51acaa Jul 07 13:33:16.425769 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.425736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" event={"ID":"c354e9c4-7ee1-4701-9b44-ba34b82e2504","Type":"ContainerStarted","Data":"436d2bea45ae95e8aeadc13cc4dd78199d47adc732dc445c10abe9b1be51acaa"} Jul 07 13:33:16.923336 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.923295 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr"] Jul 07 13:33:16.926142 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.926118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:16.930057 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.930024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9tmdw\"" Jul 07 13:33:16.938882 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:16.938830 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr"] Jul 07 13:33:17.057464 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.057430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmp9f\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-kube-api-access-pmp9f\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.057658 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.057511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.158804 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.158761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmp9f\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-kube-api-access-pmp9f\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.158966 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.158824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.173569 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.173497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmp9f\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-kube-api-access-pmp9f\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.173894 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.173856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/458da33e-d9eb-48f0-adcb-f33b47a070f4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qvqlr\" (UID: \"458da33e-d9eb-48f0-adcb-f33b47a070f4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:17.240810 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:17.240778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" Jul 07 13:33:18.034247 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:18.034219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr"] Jul 07 13:33:18.439216 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:18.439177 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerStarted","Data":"452527cd04ec3536902ed8f05f47830afc10434383e0f956d4720f56b772bfc8"} Jul 07 13:33:18.876933 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:18.876900 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod458da33e_d9eb_48f0_adcb_f33b47a070f4.slice/crio-bafa7e6f561e89e718b1a2d26fa19b073e1a6dc1fa12f683b794e851609ce1af WatchSource:0}: Error finding container bafa7e6f561e89e718b1a2d26fa19b073e1a6dc1fa12f683b794e851609ce1af: Status 404 returned error can't find the container with id bafa7e6f561e89e718b1a2d26fa19b073e1a6dc1fa12f683b794e851609ce1af Jul 07 13:33:19.444793 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.444754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" event={"ID":"c354e9c4-7ee1-4701-9b44-ba34b82e2504","Type":"ContainerStarted","Data":"4e93a0c0812145c46a401c52804e791aa8dff87fe985abebc43c0b29aee8ae5b"} Jul 07 13:33:19.445236 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.444823 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:19.446035 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.446007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" event={"ID":"458da33e-d9eb-48f0-adcb-f33b47a070f4","Type":"ContainerStarted","Data":"bafa7e6f561e89e718b1a2d26fa19b073e1a6dc1fa12f683b794e851609ce1af"} Jul 07 13:33:19.447585 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.447553 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9571f6-a596-4652-9191-57452fa72417" containerID="452527cd04ec3536902ed8f05f47830afc10434383e0f956d4720f56b772bfc8" exitCode=0 Jul 07 13:33:19.447670 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.447637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerDied","Data":"452527cd04ec3536902ed8f05f47830afc10434383e0f956d4720f56b772bfc8"} Jul 07 13:33:19.490160 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:19.490087 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" podStartSLOduration=1.669279218 podStartE2EDuration="4.490067278s" totalImagesPullingTime="2.82078806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:33:19.485987698 +0000 UTC m=+341.240397945" watchObservedRunningTime="2026-07-07 13:33:19.490067278 +0000 UTC m=+341.244477526" Jul 07 13:33:20.453816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:20.453778 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" event={"ID":"458da33e-d9eb-48f0-adcb-f33b47a070f4","Type":"ContainerStarted","Data":"533b47da3ab76f82ebb4b7621055902e2cacd108ae7ac72c19b52a616b593c55"} Jul 07 13:33:20.455926 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:20.455896 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9571f6-a596-4652-9191-57452fa72417" containerID="66fbd6a0395a9b6b10ab831e0481204e04d14fd3db7319e7b92d817eab98182d" exitCode=0 Jul 07 13:33:20.456037 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:20.455965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerDied","Data":"66fbd6a0395a9b6b10ab831e0481204e04d14fd3db7319e7b92d817eab98182d"} Jul 07 13:33:20.471717 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:20.471676 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qvqlr" podStartSLOduration=3.640075822 podStartE2EDuration="4.471662291s" totalImagesPullingTime="831.586469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:33:20.471059842 +0000 UTC m=+342.225470092" watchObservedRunningTime="2026-07-07 13:33:20.471662291 +0000 UTC m=+342.226072539" Jul 07 13:33:21.589671 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.589645 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:21.704175 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.704144 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjb67\" (UniqueName: \"kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67\") pod \"2b9571f6-a596-4652-9191-57452fa72417\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " Jul 07 13:33:21.704336 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.704227 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util\") pod \"2b9571f6-a596-4652-9191-57452fa72417\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " Jul 07 13:33:21.704336 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.704260 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle\") pod \"2b9571f6-a596-4652-9191-57452fa72417\" (UID: \"2b9571f6-a596-4652-9191-57452fa72417\") " Jul 07 13:33:21.704697 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.704670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle" (OuterVolumeSpecName: "bundle") pod "2b9571f6-a596-4652-9191-57452fa72417" (UID: "2b9571f6-a596-4652-9191-57452fa72417"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:21.706314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.706294 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67" (OuterVolumeSpecName: "kube-api-access-cjb67") pod "2b9571f6-a596-4652-9191-57452fa72417" (UID: "2b9571f6-a596-4652-9191-57452fa72417"). InnerVolumeSpecName "kube-api-access-cjb67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:33:21.710313 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.710290 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util" (OuterVolumeSpecName: "util") pod "2b9571f6-a596-4652-9191-57452fa72417" (UID: "2b9571f6-a596-4652-9191-57452fa72417"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:21.805131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.805085 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:21.805131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.805125 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9571f6-a596-4652-9191-57452fa72417-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:21.805131 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:21.805135 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjb67\" (UniqueName: \"kubernetes.io/projected/2b9571f6-a596-4652-9191-57452fa72417-kube-api-access-cjb67\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:22.467303 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:22.467275 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" Jul 07 13:33:22.467303 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:22.467278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpvqck" event={"ID":"2b9571f6-a596-4652-9191-57452fa72417","Type":"ContainerDied","Data":"1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47"} Jul 07 13:33:22.467599 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:22.467321 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d77bbf9cfb82c1960d6aa7159e4b02b9e4af682a27fbed3f7e941017bf96f47" Jul 07 13:33:25.458302 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:25.458265 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2cm72" Jul 07 13:33:34.407410 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407335 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7"] Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407707 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="pull" Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407719 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="pull" Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407726 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="extract" Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407732 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="extract" Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407752 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="util" Jul 07 13:33:34.407771 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407757 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="util" Jul 07 13:33:34.407953 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.407809 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9571f6-a596-4652-9191-57452fa72417" containerName="extract" Jul 07 13:33:34.410722 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.410705 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.413633 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.413613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 13:33:34.413753 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.413654 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hvzgn\"" Jul 07 13:33:34.414654 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.414637 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 13:33:34.421638 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.421618 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7"] Jul 07 13:33:34.514225 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.514198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.514353 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.514230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.514353 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.514257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrd7g\" (UniqueName: \"kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.614834 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.614808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd7g\" (UniqueName: \"kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.614975 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.614877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.614975 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.614902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.615213 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.615198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.615251 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.615234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.628232 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.628199 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrd7g\" (UniqueName: \"kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.720209 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.720134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:34.855957 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:34.855934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7"] Jul 07 13:33:34.857691 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:34.857663 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716f1415_5ebf_4739_bf1e_9b2c69bd17c1.slice/crio-7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0 WatchSource:0}: Error finding container 7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0: Status 404 returned error can't find the container with id 7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0 Jul 07 13:33:35.528063 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:35.528026 2565 generic.go:356] "Generic (PLEG): container finished" podID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerID="ff26c00bbf9a75bb289f76c6e6d3f5f32890258532eee3840c5c17d0cca56d18" exitCode=0 Jul 07 13:33:35.528459 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:35.528072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" event={"ID":"716f1415-5ebf-4739-bf1e-9b2c69bd17c1","Type":"ContainerDied","Data":"ff26c00bbf9a75bb289f76c6e6d3f5f32890258532eee3840c5c17d0cca56d18"} Jul 07 13:33:35.528459 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:35.528123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" event={"ID":"716f1415-5ebf-4739-bf1e-9b2c69bd17c1","Type":"ContainerStarted","Data":"7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0"} Jul 07 13:33:36.534948 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:36.534917 2565 generic.go:356] "Generic (PLEG): container finished" podID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerID="03503d42e4e056c8109ae4a88b0ba0a796a76690bb220dd7df46765da22accf1" exitCode=0 Jul 07 13:33:36.535325 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:36.535007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" event={"ID":"716f1415-5ebf-4739-bf1e-9b2c69bd17c1","Type":"ContainerDied","Data":"03503d42e4e056c8109ae4a88b0ba0a796a76690bb220dd7df46765da22accf1"} Jul 07 13:33:37.541254 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:37.541223 2565 generic.go:356] "Generic (PLEG): container finished" podID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerID="bbf06cf78968c9a6066c7b46b90bace3c5b153bf7354c5cded9f24da5218256a" exitCode=0 Jul 07 13:33:37.541647 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:37.541315 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" event={"ID":"716f1415-5ebf-4739-bf1e-9b2c69bd17c1","Type":"ContainerDied","Data":"bbf06cf78968c9a6066c7b46b90bace3c5b153bf7354c5cded9f24da5218256a"} Jul 07 13:33:38.672158 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.672134 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:38.851703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.851627 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util\") pod \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " Jul 07 13:33:38.851703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.851684 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrd7g\" (UniqueName: \"kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g\") pod \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " Jul 07 13:33:38.851889 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.851741 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle\") pod \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\" (UID: \"716f1415-5ebf-4739-bf1e-9b2c69bd17c1\") " Jul 07 13:33:38.852469 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.852419 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle" (OuterVolumeSpecName: "bundle") pod "716f1415-5ebf-4739-bf1e-9b2c69bd17c1" (UID: "716f1415-5ebf-4739-bf1e-9b2c69bd17c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:38.853954 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.853927 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g" (OuterVolumeSpecName: "kube-api-access-rrd7g") pod "716f1415-5ebf-4739-bf1e-9b2c69bd17c1" (UID: "716f1415-5ebf-4739-bf1e-9b2c69bd17c1"). InnerVolumeSpecName "kube-api-access-rrd7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:33:38.857713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.857690 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util" (OuterVolumeSpecName: "util") pod "716f1415-5ebf-4739-bf1e-9b2c69bd17c1" (UID: "716f1415-5ebf-4739-bf1e-9b2c69bd17c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:33:38.952752 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.952720 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:38.952752 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.952747 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrd7g\" (UniqueName: \"kubernetes.io/projected/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-kube-api-access-rrd7g\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:38.952752 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:38.952758 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/716f1415-5ebf-4739-bf1e-9b2c69bd17c1-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:33:39.552228 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:39.552196 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" Jul 07 13:33:39.552228 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:39.552199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6kfn7" event={"ID":"716f1415-5ebf-4739-bf1e-9b2c69bd17c1","Type":"ContainerDied","Data":"7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0"} Jul 07 13:33:39.552514 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:39.552250 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a529c8429cf7a76bdfece827ba8774eeeaf448981205dd4548e05bffb6f32b0" Jul 07 13:33:47.705465 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705432 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f"] Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705761 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="extract" Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705773 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="extract" Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705783 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="util" Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705789 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="util" Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705809 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="pull" Jul 07 13:33:47.705878 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705815 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="pull" Jul 07 13:33:47.706071 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.705883 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="716f1415-5ebf-4739-bf1e-9b2c69bd17c1" containerName="extract" Jul 07 13:33:47.708374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.708358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.715192 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.715155 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 13:33:47.715319 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.715205 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 13:33:47.715379 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.715318 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nb9q7\"" Jul 07 13:33:47.715464 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.715423 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 13:33:47.715609 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.715549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 13:33:47.726759 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.726738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-tmp\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.726844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.726766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bz47\" (UniqueName: \"kubernetes.io/projected/be0a73a3-a1fe-4b0e-a44d-f64f62112985-kube-api-access-9bz47\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.726844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.726798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-manifests\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.726934 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.726915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.726974 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.726950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.736763 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.736740 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f"] Jul 07 13:33:47.827319 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.827319 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.827588 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-tmp\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.827588 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bz47\" (UniqueName: \"kubernetes.io/projected/be0a73a3-a1fe-4b0e-a44d-f64f62112985-kube-api-access-9bz47\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.827588 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-manifests\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.827856 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.827826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-manifests\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.829802 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.829778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be0a73a3-a1fe-4b0e-a44d-f64f62112985-tmp\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.829910 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.829882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-webhook-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.830087 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.830067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be0a73a3-a1fe-4b0e-a44d-f64f62112985-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:47.846688 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:47.846659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bz47\" (UniqueName: \"kubernetes.io/projected/be0a73a3-a1fe-4b0e-a44d-f64f62112985-kube-api-access-9bz47\") pod \"opendatahub-operator-controller-manager-76f9489749-wm84f\" (UID: \"be0a73a3-a1fe-4b0e-a44d-f64f62112985\") " pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:48.019006 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:48.018924 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:48.167314 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:48.167254 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f"] Jul 07 13:33:48.169568 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:33:48.169538 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0a73a3_a1fe_4b0e_a44d_f64f62112985.slice/crio-18a6d3c91df965a08cfbbd9ba4d925f0313f4bb4de61b10c5a40bea4520bf1db WatchSource:0}: Error finding container 18a6d3c91df965a08cfbbd9ba4d925f0313f4bb4de61b10c5a40bea4520bf1db: Status 404 returned error can't find the container with id 18a6d3c91df965a08cfbbd9ba4d925f0313f4bb4de61b10c5a40bea4520bf1db Jul 07 13:33:48.592849 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:48.592815 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" event={"ID":"be0a73a3-a1fe-4b0e-a44d-f64f62112985","Type":"ContainerStarted","Data":"18a6d3c91df965a08cfbbd9ba4d925f0313f4bb4de61b10c5a40bea4520bf1db"} Jul 07 13:33:51.608908 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:51.608825 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" event={"ID":"be0a73a3-a1fe-4b0e-a44d-f64f62112985","Type":"ContainerStarted","Data":"6927255ccd609e6485323293480a261a8470b3eea81c3152cd267408e95d69aa"} Jul 07 13:33:52.615445 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:52.615413 2565 generic.go:356] "Generic (PLEG): container finished" podID="be0a73a3-a1fe-4b0e-a44d-f64f62112985" containerID="6927255ccd609e6485323293480a261a8470b3eea81c3152cd267408e95d69aa" exitCode=0 Jul 07 13:33:52.615824 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:52.615461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" event={"ID":"be0a73a3-a1fe-4b0e-a44d-f64f62112985","Type":"ContainerDied","Data":"6927255ccd609e6485323293480a261a8470b3eea81c3152cd267408e95d69aa"} Jul 07 13:33:53.622246 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:53.622214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" event={"ID":"be0a73a3-a1fe-4b0e-a44d-f64f62112985","Type":"ContainerStarted","Data":"f6516095c86189f6634d5c86a5aaf1121cfcc68fabc1196e69f93d7801586145"} Jul 07 13:33:53.622719 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:53.622336 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:33:53.672895 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:33:53.672847 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" podStartSLOduration=2.186794742 podStartE2EDuration="6.672832303s" totalImagesPullingTime="3.437809983s" totalInitContainerRuntime="1.048227578s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:33:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:33:53.669501695 +0000 UTC m=+375.423911935" watchObservedRunningTime="2026-07-07 13:33:53.672832303 +0000 UTC m=+375.427242551" Jul 07 13:34:04.629194 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:04.629159 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76f9489749-wm84f" Jul 07 13:34:07.459279 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.459245 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbzzr"] Jul 07 13:34:07.468101 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.468077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.470765 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.470742 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 13:34:07.470901 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.470762 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b976p\"" Jul 07 13:34:07.475323 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.475301 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbzzr"] Jul 07 13:34:07.541529 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.541497 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62"] Jul 07 13:34:07.544877 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.544854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.547852 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.547798 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 13:34:07.548048 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.548032 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 13:34:07.548313 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.548291 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 13:34:07.548525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.548467 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-db7gh\"" Jul 07 13:34:07.548525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.548522 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 13:34:07.548824 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.548806 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 13:34:07.557697 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.557678 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62"] Jul 07 13:34:07.598662 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.598831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.598831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qft6j\" (UniqueName: \"kubernetes.io/projected/85124ebc-213f-42c0-8acd-676d3d6e3652-kube-api-access-qft6j\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.598831 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-metrics-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.598961 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25qxh\" (UniqueName: \"kubernetes.io/projected/dd308b2c-d695-4bea-8f74-eb202e1129c2-kube-api-access-25qxh\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.598961 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.598933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd308b2c-d695-4bea-8f74-eb202e1129c2-manager-config\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.699768 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.699736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25qxh\" (UniqueName: \"kubernetes.io/projected/dd308b2c-d695-4bea-8f74-eb202e1129c2-kube-api-access-25qxh\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.699951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.699807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd308b2c-d695-4bea-8f74-eb202e1129c2-manager-config\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.699951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.699841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.699951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.699875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.699951 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.699902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qft6j\" (UniqueName: \"kubernetes.io/projected/85124ebc-213f-42c0-8acd-676d3d6e3652-kube-api-access-qft6j\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.700203 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:34:07.700006 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 13:34:07.700203 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.700014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-metrics-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.700203 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:34:07.700085 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert podName:85124ebc-213f-42c0-8acd-676d3d6e3652 nodeName:}" failed. No retries permitted until 2026-07-07 13:34:08.200061187 +0000 UTC m=+389.954471420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert") pod "odh-model-controller-7998c67dc4-fbzzr" (UID: "85124ebc-213f-42c0-8acd-676d3d6e3652") : secret "odh-model-controller-webhook-cert" not found Jul 07 13:34:07.700581 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.700561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd308b2c-d695-4bea-8f74-eb202e1129c2-manager-config\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.702748 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.702726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.702949 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.702933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd308b2c-d695-4bea-8f74-eb202e1129c2-metrics-cert\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.713156 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.713083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25qxh\" (UniqueName: \"kubernetes.io/projected/dd308b2c-d695-4bea-8f74-eb202e1129c2-kube-api-access-25qxh\") pod \"lws-controller-manager-5dbf57879c-5ww62\" (UID: \"dd308b2c-d695-4bea-8f74-eb202e1129c2\") " pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:07.714245 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.714224 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qft6j\" (UniqueName: \"kubernetes.io/projected/85124ebc-213f-42c0-8acd-676d3d6e3652-kube-api-access-qft6j\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:07.857184 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:07.857143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:08.009391 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.009360 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62"] Jul 07 13:34:08.010318 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:34:08.010293 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd308b2c_d695_4bea_8f74_eb202e1129c2.slice/crio-e7948a44b5e130524168c44f3fdb28cddf1b4c489cbfb461c0afce2b7089f682 WatchSource:0}: Error finding container e7948a44b5e130524168c44f3fdb28cddf1b4c489cbfb461c0afce2b7089f682: Status 404 returned error can't find the container with id e7948a44b5e130524168c44f3fdb28cddf1b4c489cbfb461c0afce2b7089f682 Jul 07 13:34:08.207865 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.207831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:08.210330 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.210304 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85124ebc-213f-42c0-8acd-676d3d6e3652-cert\") pod \"odh-model-controller-7998c67dc4-fbzzr\" (UID: \"85124ebc-213f-42c0-8acd-676d3d6e3652\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:08.381958 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.381923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:08.523349 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.523322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbzzr"] Jul 07 13:34:08.525453 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:34:08.525428 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85124ebc_213f_42c0_8acd_676d3d6e3652.slice/crio-d9acb7c95793b87bb9f05323f285a2a48e6a3f776e6c4590ace4cb15c92e6e57 WatchSource:0}: Error finding container d9acb7c95793b87bb9f05323f285a2a48e6a3f776e6c4590ace4cb15c92e6e57: Status 404 returned error can't find the container with id d9acb7c95793b87bb9f05323f285a2a48e6a3f776e6c4590ace4cb15c92e6e57 Jul 07 13:34:08.694700 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.694604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" event={"ID":"85124ebc-213f-42c0-8acd-676d3d6e3652","Type":"ContainerStarted","Data":"d9acb7c95793b87bb9f05323f285a2a48e6a3f776e6c4590ace4cb15c92e6e57"} Jul 07 13:34:08.695796 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:08.695766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" event={"ID":"dd308b2c-d695-4bea-8f74-eb202e1129c2","Type":"ContainerStarted","Data":"e7948a44b5e130524168c44f3fdb28cddf1b4c489cbfb461c0afce2b7089f682"} Jul 07 13:34:10.711318 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:10.711278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" event={"ID":"dd308b2c-d695-4bea-8f74-eb202e1129c2","Type":"ContainerStarted","Data":"ed4eee80789a5c95a1a72783eec8c37e848bbeb027d5e3dc27717b536c9b92c9"} Jul 07 13:34:10.711797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:10.711519 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:10.732048 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:10.732001 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" podStartSLOduration=1.959979076 podStartE2EDuration="3.731988241s" totalImagesPullingTime="1.772009165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:34:10.730528416 +0000 UTC m=+392.484938664" watchObservedRunningTime="2026-07-07 13:34:10.731988241 +0000 UTC m=+392.486398489" Jul 07 13:34:11.717580 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:11.717547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" event={"ID":"85124ebc-213f-42c0-8acd-676d3d6e3652","Type":"ContainerStarted","Data":"a33dee7f99ed99f3bbfa74b733ce70b1a73ae628942157870d9a3cdad80b6627"} Jul 07 13:34:11.717971 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:11.717796 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:11.738932 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:11.738885 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" podStartSLOduration=1.705850139 podStartE2EDuration="4.738869894s" totalImagesPullingTime="3.033019755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:34:11.737367027 +0000 UTC m=+393.491777274" watchObservedRunningTime="2026-07-07 13:34:11.738869894 +0000 UTC m=+393.493280142" Jul 07 13:34:16.542582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.542549 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml"] Jul 07 13:34:16.546020 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.545999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.550800 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.550781 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 13:34:16.551045 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.551029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 13:34:16.551113 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.551029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 13:34:16.551651 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.551632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hrx5l\"" Jul 07 13:34:16.551918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.551898 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 13:34:16.561875 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.561854 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml"] Jul 07 13:34:16.690391 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cfb7ab-ba98-4a03-a761-2f030743bbec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.690559 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.690522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzs4t\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-kube-api-access-rzs4t\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791343 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cfb7ab-ba98-4a03-a761-2f030743bbec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791500 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.791731 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.791652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzs4t\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-kube-api-access-rzs4t\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.792263 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.792242 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.794109 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.794055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.794195 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.794166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cfb7ab-ba98-4a03-a761-2f030743bbec-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.794374 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.794348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.794512 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.794476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a9cfb7ab-ba98-4a03-a761-2f030743bbec-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.802033 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.802005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzs4t\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-kube-api-access-rzs4t\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.804310 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.804288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cfb7ab-ba98-4a03-a761-2f030743bbec-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nq2ml\" (UID: \"a9cfb7ab-ba98-4a03-a761-2f030743bbec\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:16.855864 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:16.855842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:17.068220 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:17.068152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml"] Jul 07 13:34:17.071974 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:34:17.071949 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cfb7ab_ba98_4a03_a761_2f030743bbec.slice/crio-e8c00da504e1202f3425f12917804187a48ea48ecf8556b3b7f423214a83c9d5 WatchSource:0}: Error finding container e8c00da504e1202f3425f12917804187a48ea48ecf8556b3b7f423214a83c9d5: Status 404 returned error can't find the container with id e8c00da504e1202f3425f12917804187a48ea48ecf8556b3b7f423214a83c9d5 Jul 07 13:34:17.752257 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:17.752213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" event={"ID":"a9cfb7ab-ba98-4a03-a761-2f030743bbec","Type":"ContainerStarted","Data":"e8c00da504e1202f3425f12917804187a48ea48ecf8556b3b7f423214a83c9d5"} Jul 07 13:34:19.517431 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:19.517389 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 13:34:19.517791 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:19.517466 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 07 13:34:19.771205 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:19.771131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" event={"ID":"a9cfb7ab-ba98-4a03-a761-2f030743bbec","Type":"ContainerStarted","Data":"834c4201dcd177a55f240d3b98ece4b6cea0cc453f0bf914809a897e2f6c9ac4"} Jul 07 13:34:19.771348 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:19.771252 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:34:19.832534 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:19.832438 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" podStartSLOduration=1.389026532 podStartE2EDuration="3.832418686s" totalImagesPullingTime="2.443392154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:34:19.831844317 +0000 UTC m=+401.586254564" watchObservedRunningTime="2026-07-07 13:34:19.832418686 +0000 UTC m=+401.586828939" Jul 07 13:34:20.778155 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:20.778119 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nq2ml container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 13:34:20.778535 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:20.778180 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" podUID="a9cfb7ab-ba98-4a03-a761-2f030743bbec" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 13:34:21.720355 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:21.720323 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dbf57879c-5ww62" Jul 07 13:34:22.726161 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:22.726129 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbzzr" Jul 07 13:34:23.777760 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:34:23.777731 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nq2ml" Jul 07 13:35:24.309713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.309676 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm"] Jul 07 13:35:24.312398 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.312381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.315472 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.315453 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qcjrm\"" Jul 07 13:35:24.316621 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.316598 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 13:35:24.316621 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.316614 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 13:35:24.326807 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.326785 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm"] Jul 07 13:35:24.377016 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.376992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.377176 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.377156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57bcf\" (UniqueName: \"kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.377222 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.377190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.478244 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.478206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57bcf\" (UniqueName: \"kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.478244 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.478242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.478438 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.478275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.478666 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.478646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.478710 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.478652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.487198 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.487172 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57bcf\" (UniqueName: \"kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.621594 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.621571 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:24.760920 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.760896 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm"] Jul 07 13:35:24.762859 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:35:24.762834 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc322ffc_c6b3_4c35_a580_62e18968ada9.slice/crio-40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b WatchSource:0}: Error finding container 40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b: Status 404 returned error can't find the container with id 40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b Jul 07 13:35:24.911896 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.911824 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv"] Jul 07 13:35:24.914887 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.914870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:24.924705 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.924679 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv"] Jul 07 13:35:24.982968 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.982939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:24.983104 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.982978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmtc4\" (UniqueName: \"kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:24.983104 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:24.983010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.083523 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.083477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmtc4\" (UniqueName: \"kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.083682 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.083560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.083754 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.083688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.083918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.083894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.083989 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.083968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.085971 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.085941 2565 generic.go:356] "Generic (PLEG): container finished" podID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerID="f732f0344c0a3362d65c39f7742da82ca7af30a5d72b1308ce27aac570818de2" exitCode=0 Jul 07 13:35:25.086054 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.086016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" event={"ID":"bc322ffc-c6b3-4c35-a580-62e18968ada9","Type":"ContainerDied","Data":"f732f0344c0a3362d65c39f7742da82ca7af30a5d72b1308ce27aac570818de2"} Jul 07 13:35:25.086107 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.086069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" event={"ID":"bc322ffc-c6b3-4c35-a580-62e18968ada9","Type":"ContainerStarted","Data":"40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b"} Jul 07 13:35:25.093352 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.093331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmtc4\" (UniqueName: \"kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.235928 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.235853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:25.303059 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.303033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz"] Jul 07 13:35:25.305781 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.305758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.317356 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.317328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz"] Jul 07 13:35:25.376455 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.376430 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv"] Jul 07 13:35:25.378294 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:35:25.378263 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ece59e2_c7be_4758_963f_2e8c0cf68ff3.slice/crio-e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d WatchSource:0}: Error finding container e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d: Status 404 returned error can't find the container with id e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d Jul 07 13:35:25.385835 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.385813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtj2\" (UniqueName: \"kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.385933 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.385868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.385933 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.385924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.487298 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.487236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.487298 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.487280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.487428 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.487410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtj2\" (UniqueName: \"kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.487708 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.487692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.487752 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.487712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.496877 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.496858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtj2\" (UniqueName: \"kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.615250 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.615223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:25.717301 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.716654 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz"] Jul 07 13:35:25.721522 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.721478 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.730919 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.730551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz"] Jul 07 13:35:25.754055 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.754034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz"] Jul 07 13:35:25.776776 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:35:25.776748 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8de2b54_c9b1_4465_8ec5_f8c580cf557c.slice/crio-c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec WatchSource:0}: Error finding container c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec: Status 404 returned error can't find the container with id c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec Jul 07 13:35:25.790019 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.789997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.790113 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.790032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqfs\" (UniqueName: \"kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.790113 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.790057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.890827 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.890800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.890966 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.890842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqfs\" (UniqueName: \"kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.891139 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.891100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.891212 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.891160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.891415 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.891397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:25.900879 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:25.900850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqfs\" (UniqueName: \"kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:26.035730 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.035647 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:26.098525 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.098449 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerID="851a9b12fb2c50e7d278ec2795d6f37ef2df3fd44656c12c0ca2cf1eb95df92c" exitCode=0 Jul 07 13:35:26.098645 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.098524 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerDied","Data":"851a9b12fb2c50e7d278ec2795d6f37ef2df3fd44656c12c0ca2cf1eb95df92c"} Jul 07 13:35:26.098645 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.098605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerStarted","Data":"e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d"} Jul 07 13:35:26.103245 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.103216 2565 generic.go:356] "Generic (PLEG): container finished" podID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerID="69bb499cabbfbcc1c84531ec05885742d7f7d5833f4643f7d49ec567263889de" exitCode=0 Jul 07 13:35:26.103330 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.103302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" event={"ID":"bc322ffc-c6b3-4c35-a580-62e18968ada9","Type":"ContainerDied","Data":"69bb499cabbfbcc1c84531ec05885742d7f7d5833f4643f7d49ec567263889de"} Jul 07 13:35:26.105785 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.105756 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerID="465b8f15d0aa330b1d83f75de6efaa706266ace7828fb5656134e9d9112cce57" exitCode=0 Jul 07 13:35:26.105879 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.105853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" event={"ID":"e8de2b54-c9b1-4465-8ec5-f8c580cf557c","Type":"ContainerDied","Data":"465b8f15d0aa330b1d83f75de6efaa706266ace7828fb5656134e9d9112cce57"} Jul 07 13:35:26.105948 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.105896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" event={"ID":"e8de2b54-c9b1-4465-8ec5-f8c580cf557c","Type":"ContainerStarted","Data":"c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec"} Jul 07 13:35:26.199606 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:26.199577 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz"] Jul 07 13:35:26.200740 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:35:26.200719 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab55843_2a98_4075_9216_1ed29765fbea.slice/crio-e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092 WatchSource:0}: Error finding container e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092: Status 404 returned error can't find the container with id e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092 Jul 07 13:35:27.114286 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.114255 2565 generic.go:356] "Generic (PLEG): container finished" podID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerID="65a5dd0c885b400f95efbc06cb4176a842288477a0b00419653477eb484b22ec" exitCode=0 Jul 07 13:35:27.114699 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.114332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" event={"ID":"bc322ffc-c6b3-4c35-a580-62e18968ada9","Type":"ContainerDied","Data":"65a5dd0c885b400f95efbc06cb4176a842288477a0b00419653477eb484b22ec"} Jul 07 13:35:27.115861 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.115840 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ab55843-2a98-4075-9216-1ed29765fbea" containerID="b72aa3abd37f840e863c55ca4a00b61745c8f95243a3500569926ef710ee7bb7" exitCode=0 Jul 07 13:35:27.115953 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.115942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" event={"ID":"2ab55843-2a98-4075-9216-1ed29765fbea","Type":"ContainerDied","Data":"b72aa3abd37f840e863c55ca4a00b61745c8f95243a3500569926ef710ee7bb7"} Jul 07 13:35:27.116025 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.115973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" event={"ID":"2ab55843-2a98-4075-9216-1ed29765fbea","Type":"ContainerStarted","Data":"e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092"} Jul 07 13:35:27.117944 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:27.117917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerStarted","Data":"5943c0709842f0b680fd64cd039c48c812566cd03f9b24675666e173e4615be4"} Jul 07 13:35:28.126100 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.126069 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerID="84b9ff721b5fd71f6d4875c017da0ad461c7c0dc02ff9e1379501903158545c8" exitCode=0 Jul 07 13:35:28.126563 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.126156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" event={"ID":"e8de2b54-c9b1-4465-8ec5-f8c580cf557c","Type":"ContainerDied","Data":"84b9ff721b5fd71f6d4875c017da0ad461c7c0dc02ff9e1379501903158545c8"} Jul 07 13:35:28.128060 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.128039 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ab55843-2a98-4075-9216-1ed29765fbea" containerID="80383f7c2bf8e980c4ce152c3a85dff7156cdc040d7fe9d81966f9feae94987d" exitCode=0 Jul 07 13:35:28.128156 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.128142 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" event={"ID":"2ab55843-2a98-4075-9216-1ed29765fbea","Type":"ContainerDied","Data":"80383f7c2bf8e980c4ce152c3a85dff7156cdc040d7fe9d81966f9feae94987d"} Jul 07 13:35:28.130193 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.130170 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerID="5943c0709842f0b680fd64cd039c48c812566cd03f9b24675666e173e4615be4" exitCode=0 Jul 07 13:35:28.130274 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.130246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerDied","Data":"5943c0709842f0b680fd64cd039c48c812566cd03f9b24675666e173e4615be4"} Jul 07 13:35:28.270682 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.270659 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:28.313721 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.313692 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util\") pod \"bc322ffc-c6b3-4c35-a580-62e18968ada9\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " Jul 07 13:35:28.313859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.313731 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57bcf\" (UniqueName: \"kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf\") pod \"bc322ffc-c6b3-4c35-a580-62e18968ada9\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " Jul 07 13:35:28.313859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.313766 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle\") pod \"bc322ffc-c6b3-4c35-a580-62e18968ada9\" (UID: \"bc322ffc-c6b3-4c35-a580-62e18968ada9\") " Jul 07 13:35:28.314467 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.314379 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle" (OuterVolumeSpecName: "bundle") pod "bc322ffc-c6b3-4c35-a580-62e18968ada9" (UID: "bc322ffc-c6b3-4c35-a580-62e18968ada9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:28.315932 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.315908 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf" (OuterVolumeSpecName: "kube-api-access-57bcf") pod "bc322ffc-c6b3-4c35-a580-62e18968ada9" (UID: "bc322ffc-c6b3-4c35-a580-62e18968ada9"). InnerVolumeSpecName "kube-api-access-57bcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:35:28.319659 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.319628 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util" (OuterVolumeSpecName: "util") pod "bc322ffc-c6b3-4c35-a580-62e18968ada9" (UID: "bc322ffc-c6b3-4c35-a580-62e18968ada9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:28.415297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.415269 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:28.415297 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.415295 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57bcf\" (UniqueName: \"kubernetes.io/projected/bc322ffc-c6b3-4c35-a580-62e18968ada9-kube-api-access-57bcf\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:28.415427 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:28.415308 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc322ffc-c6b3-4c35-a580-62e18968ada9-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:29.138727 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.138685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" event={"ID":"bc322ffc-c6b3-4c35-a580-62e18968ada9","Type":"ContainerDied","Data":"40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b"} Jul 07 13:35:29.139150 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.138756 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40bdfa271060a40e1d5f8c8184d4da7fca3ad319969cf6d39b128960d1ec637b" Jul 07 13:35:29.139150 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.138700 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm" Jul 07 13:35:29.141000 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.140917 2565 generic.go:356] "Generic (PLEG): container finished" podID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerID="ad76eb4298554f0d33ada5ed84f2177d8868c8b5505b6442fcf5fac9cd2f531d" exitCode=0 Jul 07 13:35:29.141120 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.141061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" event={"ID":"e8de2b54-c9b1-4465-8ec5-f8c580cf557c","Type":"ContainerDied","Data":"ad76eb4298554f0d33ada5ed84f2177d8868c8b5505b6442fcf5fac9cd2f531d"} Jul 07 13:35:29.143173 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.143154 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ab55843-2a98-4075-9216-1ed29765fbea" containerID="990dc8059a8072ec606c3edd15d9004103d077f6f5b1007de543dedc8769e16d" exitCode=0 Jul 07 13:35:29.143264 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.143239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" event={"ID":"2ab55843-2a98-4075-9216-1ed29765fbea","Type":"ContainerDied","Data":"990dc8059a8072ec606c3edd15d9004103d077f6f5b1007de543dedc8769e16d"} Jul 07 13:35:29.145239 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.145218 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerID="8c18dce8c2b9e6bceed1e0fe01b35da21d5399c8d3145681e541643ac4a89f14" exitCode=0 Jul 07 13:35:29.145320 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:29.145270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerDied","Data":"8c18dce8c2b9e6bceed1e0fe01b35da21d5399c8d3145681e541643ac4a89f14"} Jul 07 13:35:30.304884 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.304848 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:30.331375 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.331355 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle\") pod \"2ab55843-2a98-4075-9216-1ed29765fbea\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " Jul 07 13:35:30.331532 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.331381 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util\") pod \"2ab55843-2a98-4075-9216-1ed29765fbea\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " Jul 07 13:35:30.331532 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.331439 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fqfs\" (UniqueName: \"kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs\") pod \"2ab55843-2a98-4075-9216-1ed29765fbea\" (UID: \"2ab55843-2a98-4075-9216-1ed29765fbea\") " Jul 07 13:35:30.332007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.331937 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle" (OuterVolumeSpecName: "bundle") pod "2ab55843-2a98-4075-9216-1ed29765fbea" (UID: "2ab55843-2a98-4075-9216-1ed29765fbea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.332007 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.331974 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:30.334291 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.334268 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs" (OuterVolumeSpecName: "kube-api-access-7fqfs") pod "2ab55843-2a98-4075-9216-1ed29765fbea" (UID: "2ab55843-2a98-4075-9216-1ed29765fbea"). InnerVolumeSpecName "kube-api-access-7fqfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:35:30.336221 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.336201 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:30.339332 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.339306 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util" (OuterVolumeSpecName: "util") pod "2ab55843-2a98-4075-9216-1ed29765fbea" (UID: "2ab55843-2a98-4075-9216-1ed29765fbea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.432573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432466 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle\") pod \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " Jul 07 13:35:30.432573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432521 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmtc4\" (UniqueName: \"kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4\") pod \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " Jul 07 13:35:30.432573 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432555 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util\") pod \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " Jul 07 13:35:30.432894 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432593 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle\") pod \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " Jul 07 13:35:30.432894 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432625 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util\") pod \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\" (UID: \"5ece59e2-c7be-4758-963f-2e8c0cf68ff3\") " Jul 07 13:35:30.432894 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhtj2\" (UniqueName: \"kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2\") pod \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\" (UID: \"e8de2b54-c9b1-4465-8ec5-f8c580cf557c\") " Jul 07 13:35:30.433061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432950 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.433061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432969 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ab55843-2a98-4075-9216-1ed29765fbea-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.433061 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.432987 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fqfs\" (UniqueName: \"kubernetes.io/projected/2ab55843-2a98-4075-9216-1ed29765fbea-kube-api-access-7fqfs\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.433194 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.433148 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle" (OuterVolumeSpecName: "bundle") pod "5ece59e2-c7be-4758-963f-2e8c0cf68ff3" (UID: "5ece59e2-c7be-4758-963f-2e8c0cf68ff3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.433299 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.433241 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle" (OuterVolumeSpecName: "bundle") pod "e8de2b54-c9b1-4465-8ec5-f8c580cf557c" (UID: "e8de2b54-c9b1-4465-8ec5-f8c580cf557c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.435425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.435404 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2" (OuterVolumeSpecName: "kube-api-access-hhtj2") pod "e8de2b54-c9b1-4465-8ec5-f8c580cf557c" (UID: "e8de2b54-c9b1-4465-8ec5-f8c580cf557c"). InnerVolumeSpecName "kube-api-access-hhtj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:35:30.435425 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.435408 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4" (OuterVolumeSpecName: "kube-api-access-nmtc4") pod "5ece59e2-c7be-4758-963f-2e8c0cf68ff3" (UID: "5ece59e2-c7be-4758-963f-2e8c0cf68ff3"). InnerVolumeSpecName "kube-api-access-nmtc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:35:30.441750 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.441709 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util" (OuterVolumeSpecName: "util") pod "5ece59e2-c7be-4758-963f-2e8c0cf68ff3" (UID: "5ece59e2-c7be-4758-963f-2e8c0cf68ff3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.441844 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.441827 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util" (OuterVolumeSpecName: "util") pod "e8de2b54-c9b1-4465-8ec5-f8c580cf557c" (UID: "e8de2b54-c9b1-4465-8ec5-f8c580cf557c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:35:30.534136 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534105 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.534136 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534131 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.534136 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534140 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-util\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.534328 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534148 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhtj2\" (UniqueName: \"kubernetes.io/projected/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-kube-api-access-hhtj2\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.534328 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534158 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8de2b54-c9b1-4465-8ec5-f8c580cf557c-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:30.534328 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:30.534168 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmtc4\" (UniqueName: \"kubernetes.io/projected/5ece59e2-c7be-4758-963f-2e8c0cf68ff3-kube-api-access-nmtc4\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:35:31.157868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.157839 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" Jul 07 13:35:31.157868 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.157856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz" event={"ID":"e8de2b54-c9b1-4465-8ec5-f8c580cf557c","Type":"ContainerDied","Data":"c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec"} Jul 07 13:35:31.158100 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.157904 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c507b33a4961f23c41c3942c8994b22df6c351d8949c062067ebf08bcce1d2ec" Jul 07 13:35:31.160037 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.159963 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" Jul 07 13:35:31.160037 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.160003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz" event={"ID":"2ab55843-2a98-4075-9216-1ed29765fbea","Type":"ContainerDied","Data":"e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092"} Jul 07 13:35:31.160219 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.160044 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6e5cf429f5cf2b7c84c60187cfd0d5037b3afe618ce0b2462719543bc3a0092" Jul 07 13:35:31.162345 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.162322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" event={"ID":"5ece59e2-c7be-4758-963f-2e8c0cf68ff3","Type":"ContainerDied","Data":"e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d"} Jul 07 13:35:31.162345 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.162336 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv" Jul 07 13:35:31.162508 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:35:31.162355 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e708abe555d138354a339c006f0ba0ef288f799afabecf5f13a58bd351725a6d" Jul 07 13:36:06.674848 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.674820 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675150 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675162 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675171 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675176 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675189 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675194 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675204 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675209 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675217 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675222 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675228 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675232 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="pull" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675238 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675243 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675250 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675255 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675263 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675268 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="extract" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675276 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675280 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675290 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675295 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="util" Jul 07 13:36:06.675307 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675300 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="util" Jul 07 13:36:06.676040 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675356 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab55843-2a98-4075-9216-1ed29765fbea" containerName="extract" Jul 07 13:36:06.676040 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675364 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ece59e2-c7be-4758-963f-2e8c0cf68ff3" containerName="extract" Jul 07 13:36:06.676040 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675372 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8de2b54-c9b1-4465-8ec5-f8c580cf557c" containerName="extract" Jul 07 13:36:06.676040 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.675378 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc322ffc-c6b3-4c35-a580-62e18968ada9" containerName="extract" Jul 07 13:36:06.679568 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.679548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.682557 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.682532 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 13:36:06.682557 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.682548 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 13:36:06.682687 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.682549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5rnfw\"" Jul 07 13:36:06.689447 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.689422 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:36:06.861742 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.861703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.861928 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.861791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssc78\" (UniqueName: \"kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.963331 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.963246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssc78\" (UniqueName: \"kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.963331 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.963327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.963709 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.963692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.973830 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.973805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssc78\" (UniqueName: \"kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78\") pod \"kuadrant-operator-controller-manager-86878c769f-zkshl\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:06.990793 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:06.990764 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:07.133444 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:07.133419 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:36:07.135960 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:36:07.135932 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5a1d24_e7f7_46c2_aae9_57276304ce82.slice/crio-96ef63b928bf892608c0ca64777e11a589d974b8aa27b4c95f226bd9308b89b2 WatchSource:0}: Error finding container 96ef63b928bf892608c0ca64777e11a589d974b8aa27b4c95f226bd9308b89b2: Status 404 returned error can't find the container with id 96ef63b928bf892608c0ca64777e11a589d974b8aa27b4c95f226bd9308b89b2 Jul 07 13:36:07.346539 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:07.346423 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" event={"ID":"8e5a1d24-e7f7-46c2-aae9-57276304ce82","Type":"ContainerStarted","Data":"96ef63b928bf892608c0ca64777e11a589d974b8aa27b4c95f226bd9308b89b2"} Jul 07 13:36:13.382792 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:13.382755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" event={"ID":"8e5a1d24-e7f7-46c2-aae9-57276304ce82","Type":"ContainerStarted","Data":"1aeadf1d7ec52398b53563be92228227d6cf3ac9ea293309146df23eb658c6fd"} Jul 07 13:36:13.383197 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:13.382818 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:36:13.412026 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:13.411914 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" podStartSLOduration=1.401337234 podStartE2EDuration="7.411894819s" totalImagesPullingTime="6.010557585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:36:13.407111676 +0000 UTC m=+515.161521938" watchObservedRunningTime="2026-07-07 13:36:13.411894819 +0000 UTC m=+515.166305067" Jul 07 13:36:24.390808 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:36:24.390778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:37:38.674316 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:37:38.674287 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:37:38.676833 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:37:38.676805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:39:04.914306 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.914274 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt"] Jul 07 13:39:04.916898 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.916880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:04.921054 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.921027 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 13:39:04.921176 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.921118 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gvp7x\"" Jul 07 13:39:04.921176 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.921112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 13:39:04.921295 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.921136 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 13:39:04.937257 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:04.937230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt"] Jul 07 13:39:05.022713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggzh\" (UniqueName: \"kubernetes.io/projected/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-kube-api-access-hggzh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.022866 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.022866 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.022866 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.022991 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.022991 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.022909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124217 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124217 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124475 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggzh\" (UniqueName: \"kubernetes.io/projected/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-kube-api-access-hggzh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124475 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124475 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124475 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.124770 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.124703 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.126805 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.126780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.126939 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.126921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.133347 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.133326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggzh\" (UniqueName: \"kubernetes.io/projected/d3fe3391-cd65-4a1d-8e79-eb247723d1bd-kube-api-access-hggzh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6pbzt\" (UID: \"d3fe3391-cd65-4a1d-8e79-eb247723d1bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.228068 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.227963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:05.367589 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.367558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt"] Jul 07 13:39:05.369117 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:39:05.369087 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fe3391_cd65_4a1d_8e79_eb247723d1bd.slice/crio-9397840491fb494303b5f2ee604cb24f7ae95a2ca6dfb3a60bcc57fc6d0a1bbe WatchSource:0}: Error finding container 9397840491fb494303b5f2ee604cb24f7ae95a2ca6dfb3a60bcc57fc6d0a1bbe: Status 404 returned error can't find the container with id 9397840491fb494303b5f2ee604cb24f7ae95a2ca6dfb3a60bcc57fc6d0a1bbe Jul 07 13:39:05.370872 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:05.370849 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 13:39:06.315316 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:06.315273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" event={"ID":"d3fe3391-cd65-4a1d-8e79-eb247723d1bd","Type":"ContainerStarted","Data":"9397840491fb494303b5f2ee604cb24f7ae95a2ca6dfb3a60bcc57fc6d0a1bbe"} Jul 07 13:39:07.322015 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:07.321977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" event={"ID":"d3fe3391-cd65-4a1d-8e79-eb247723d1bd","Type":"ContainerStarted","Data":"a56bfed7169388d0c3da7bbf9a439665e9693cc01242d74ab46db70728df09cd"} Jul 07 13:39:07.344548 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:07.344465 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" podStartSLOduration=2.2313705759999998 podStartE2EDuration="3.344450183s" totalImagesPullingTime="1.113079607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:39:07.342809469 +0000 UTC m=+689.097219717" watchObservedRunningTime="2026-07-07 13:39:07.344450183 +0000 UTC m=+689.098860431" Jul 07 13:39:15.228913 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:15.228882 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:15.229363 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:15.228935 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:15.241597 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:15.241578 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:15.376153 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:15.376126 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6pbzt" Jul 07 13:39:24.330725 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.330693 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz"] Jul 07 13:39:24.340356 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.340319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.344191 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.344164 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 13:39:24.346631 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.346603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz"] Jul 07 13:39:24.499818 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.499788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.499818 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.499823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.500026 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.499874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.500026 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.499903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.500026 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.499922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad86ef08-179d-4efa-a32a-8e26691c01e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.500129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.500040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n994\" (UniqueName: \"kubernetes.io/projected/ad86ef08-179d-4efa-a32a-8e26691c01e8-kube-api-access-6n994\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601108 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601108 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601108 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad86ef08-179d-4efa-a32a-8e26691c01e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n994\" (UniqueName: \"kubernetes.io/projected/ad86ef08-179d-4efa-a32a-8e26691c01e8-kube-api-access-6n994\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601403 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601613 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601439 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601677 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.601719 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.601689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.603396 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.603377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad86ef08-179d-4efa-a32a-8e26691c01e8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.603708 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.603690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad86ef08-179d-4efa-a32a-8e26691c01e8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.609535 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.609512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n994\" (UniqueName: \"kubernetes.io/projected/ad86ef08-179d-4efa-a32a-8e26691c01e8-kube-api-access-6n994\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz\" (UID: \"ad86ef08-179d-4efa-a32a-8e26691c01e8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.653816 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.653789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:24.795013 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:39:24.794982 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad86ef08_179d_4efa_a32a_8e26691c01e8.slice/crio-e033e6959b27e11c8523bc5140580eff4e78b060171150ac174205a840897b6b WatchSource:0}: Error finding container e033e6959b27e11c8523bc5140580eff4e78b060171150ac174205a840897b6b: Status 404 returned error can't find the container with id e033e6959b27e11c8523bc5140580eff4e78b060171150ac174205a840897b6b Jul 07 13:39:24.797586 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:24.797558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz"] Jul 07 13:39:25.419441 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:25.419410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" event={"ID":"ad86ef08-179d-4efa-a32a-8e26691c01e8","Type":"ContainerStarted","Data":"6fc4e3d83c665c664ed1a7ab8b17288ecb04442bc03456e255a589fdbbae4802"} Jul 07 13:39:25.419837 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:25.419460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" event={"ID":"ad86ef08-179d-4efa-a32a-8e26691c01e8","Type":"ContainerStarted","Data":"e033e6959b27e11c8523bc5140580eff4e78b060171150ac174205a840897b6b"} Jul 07 13:39:25.439627 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:25.439577 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" podStartSLOduration=1.19120536 podStartE2EDuration="1.439562968s" totalImagesPullingTime="248.357608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:39:25.437673559 +0000 UTC m=+707.192083808" watchObservedRunningTime="2026-07-07 13:39:25.439562968 +0000 UTC m=+707.193973217" Jul 07 13:39:34.654164 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:34.654084 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:34.654164 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:34.654141 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:34.666784 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:34.666758 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:39:35.484717 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:39:35.484686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz" Jul 07 13:42:38.711121 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:42:38.711053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:42:38.711121 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:42:38.711053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:46:01.777527 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:01.777428 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:46:26.798740 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:26.798696 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84758d96b7-tzrxc" podUID="1c60f296-6491-42c6-ab32-f44a3cceea59" containerName="console" containerID="cri-o://9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d" gracePeriod=15 Jul 07 13:46:27.051388 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.051333 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:46:27.230886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.230851 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.230886 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.230885 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231098 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231066 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nktd4\" (UniqueName: \"kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231115 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231185 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231166 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231232 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231183 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231284 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231243 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config\") pod \"1c60f296-6491-42c6-ab32-f44a3cceea59\" (UID: \"1c60f296-6491-42c6-ab32-f44a3cceea59\") " Jul 07 13:46:27.231610 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231577 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:46:27.231811 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231694 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:46:27.231890 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231805 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:46:27.231890 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.231856 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config" (OuterVolumeSpecName: "console-config") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:46:27.233090 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.233071 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:46:27.233638 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.233620 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:46:27.233638 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.233626 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4" (OuterVolumeSpecName: "kube-api-access-nktd4") pod "1c60f296-6491-42c6-ab32-f44a3cceea59" (UID: "1c60f296-6491-42c6-ab32-f44a3cceea59"). InnerVolumeSpecName "kube-api-access-nktd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332381 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-console-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332408 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332419 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c60f296-6491-42c6-ab32-f44a3cceea59-console-oauth-config\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332427 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nktd4\" (UniqueName: \"kubernetes.io/projected/1c60f296-6491-42c6-ab32-f44a3cceea59-kube-api-access-nktd4\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332436 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-trusted-ca-bundle\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332453 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.332461 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.332462 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c60f296-6491-42c6-ab32-f44a3cceea59-oauth-serving-cert\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:46:27.709713 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.709675 2565 generic.go:356] "Generic (PLEG): container finished" podID="1c60f296-6491-42c6-ab32-f44a3cceea59" containerID="9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d" exitCode=0 Jul 07 13:46:27.709918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.709725 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84758d96b7-tzrxc" event={"ID":"1c60f296-6491-42c6-ab32-f44a3cceea59","Type":"ContainerDied","Data":"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d"} Jul 07 13:46:27.709918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.709737 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84758d96b7-tzrxc" Jul 07 13:46:27.709918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.709801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84758d96b7-tzrxc" event={"ID":"1c60f296-6491-42c6-ab32-f44a3cceea59","Type":"ContainerDied","Data":"c9589be0100a928c42ea675d6989db7d708b0b059de5ee4cba6a765ddaa3ca14"} Jul 07 13:46:27.709918 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.709831 2565 scope.go:117] "RemoveContainer" containerID="9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d" Jul 07 13:46:27.720506 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.720470 2565 scope.go:117] "RemoveContainer" containerID="9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d" Jul 07 13:46:27.720779 ip-10-0-138-57 kubenswrapper[2565]: E0707 13:46:27.720759 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d\": container with ID starting with 9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d not found: ID does not exist" containerID="9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d" Jul 07 13:46:27.720829 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.720787 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d"} err="failed to get container status \"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d\": rpc error: code = NotFound desc = could not find container \"9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d\": container with ID starting with 9fd863cd8e4f1d4f7a6d14ac5fcf9a87b50dce1e76a0d12b179541090c62163d not found: ID does not exist" Jul 07 13:46:27.735733 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.735709 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:46:27.740344 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:27.740319 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84758d96b7-tzrxc"] Jul 07 13:46:28.801667 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:46:28.801637 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c60f296-6491-42c6-ab32-f44a3cceea59" path="/var/lib/kubelet/pods/1c60f296-6491-42c6-ab32-f44a3cceea59/volumes" Jul 07 13:47:06.365893 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:06.365818 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:47:06.366359 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:06.366037 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" podUID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" containerName="manager" containerID="cri-o://1aeadf1d7ec52398b53563be92228227d6cf3ac9ea293309146df23eb658c6fd" gracePeriod=10 Jul 07 13:47:08.933797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:08.933766 2565 generic.go:356] "Generic (PLEG): container finished" podID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" containerID="1aeadf1d7ec52398b53563be92228227d6cf3ac9ea293309146df23eb658c6fd" exitCode=0 Jul 07 13:47:08.933797 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:08.933840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" event={"ID":"8e5a1d24-e7f7-46c2-aae9-57276304ce82","Type":"ContainerDied","Data":"1aeadf1d7ec52398b53563be92228227d6cf3ac9ea293309146df23eb658c6fd"} Jul 07 13:47:09.218945 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.218922 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:47:09.294237 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.294207 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume\") pod \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " Jul 07 13:47:09.294398 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.294278 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssc78\" (UniqueName: \"kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78\") pod \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\" (UID: \"8e5a1d24-e7f7-46c2-aae9-57276304ce82\") " Jul 07 13:47:09.294703 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.294674 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e5a1d24-e7f7-46c2-aae9-57276304ce82" (UID: "8e5a1d24-e7f7-46c2-aae9-57276304ce82"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:47:09.296431 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.296403 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78" (OuterVolumeSpecName: "kube-api-access-ssc78") pod "8e5a1d24-e7f7-46c2-aae9-57276304ce82" (UID: "8e5a1d24-e7f7-46c2-aae9-57276304ce82"). InnerVolumeSpecName "kube-api-access-ssc78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:47:09.395590 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.395562 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5a1d24-e7f7-46c2-aae9-57276304ce82-extensions-socket-volume\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:47:09.395590 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.395587 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssc78\" (UniqueName: \"kubernetes.io/projected/8e5a1d24-e7f7-46c2-aae9-57276304ce82-kube-api-access-ssc78\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 13:47:09.946582 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.946553 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" Jul 07 13:47:09.947077 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.946550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl" event={"ID":"8e5a1d24-e7f7-46c2-aae9-57276304ce82","Type":"ContainerDied","Data":"96ef63b928bf892608c0ca64777e11a589d974b8aa27b4c95f226bd9308b89b2"} Jul 07 13:47:09.947077 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.946709 2565 scope.go:117] "RemoveContainer" containerID="1aeadf1d7ec52398b53563be92228227d6cf3ac9ea293309146df23eb658c6fd" Jul 07 13:47:09.970776 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.970748 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:47:09.972826 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:09.972806 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zkshl"] Jul 07 13:47:10.797181 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:10.797151 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" path="/var/lib/kubelet/pods/8e5a1d24-e7f7-46c2-aae9-57276304ce82/volumes" Jul 07 13:47:38.756963 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:38.756930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:47:38.758288 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:47:38.758266 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:48:07.555664 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.555629 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7"] Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.555988 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" containerName="manager" Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.555998 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" containerName="manager" Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.556014 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c60f296-6491-42c6-ab32-f44a3cceea59" containerName="console" Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.556019 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c60f296-6491-42c6-ab32-f44a3cceea59" containerName="console" Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.556075 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5a1d24-e7f7-46c2-aae9-57276304ce82" containerName="manager" Jul 07 13:48:07.556129 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.556084 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c60f296-6491-42c6-ab32-f44a3cceea59" containerName="console" Jul 07 13:48:07.559097 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.559079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.561859 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.561836 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5rnfw\"" Jul 07 13:48:07.562087 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.562069 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 13:48:07.562145 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.562073 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 13:48:07.581069 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.581045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7"] Jul 07 13:48:07.691075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.691040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2defe31-a9e9-4617-b99b-aca566e680c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.691075 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.691077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6stp\" (UniqueName: \"kubernetes.io/projected/f2defe31-a9e9-4617-b99b-aca566e680c8-kube-api-access-x6stp\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.792433 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.792401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2defe31-a9e9-4617-b99b-aca566e680c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.792567 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.792438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6stp\" (UniqueName: \"kubernetes.io/projected/f2defe31-a9e9-4617-b99b-aca566e680c8-kube-api-access-x6stp\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.792759 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.792741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2defe31-a9e9-4617-b99b-aca566e680c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.802192 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.802165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6stp\" (UniqueName: \"kubernetes.io/projected/f2defe31-a9e9-4617-b99b-aca566e680c8-kube-api-access-x6stp\") pod \"kuadrant-operator-controller-manager-86878c769f-6wtn7\" (UID: \"f2defe31-a9e9-4617-b99b-aca566e680c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:07.869517 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:07.869397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:08.012119 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:08.012093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7"] Jul 07 13:48:08.014082 ip-10-0-138-57 kubenswrapper[2565]: W0707 13:48:08.014051 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2defe31_a9e9_4617_b99b_aca566e680c8.slice/crio-c9d2f2afa38a0baea6d56ede7c2bb7e38c94774c1670febf5608067341d612d5 WatchSource:0}: Error finding container c9d2f2afa38a0baea6d56ede7c2bb7e38c94774c1670febf5608067341d612d5: Status 404 returned error can't find the container with id c9d2f2afa38a0baea6d56ede7c2bb7e38c94774c1670febf5608067341d612d5 Jul 07 13:48:08.249156 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:08.249118 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" event={"ID":"f2defe31-a9e9-4617-b99b-aca566e680c8","Type":"ContainerStarted","Data":"8afd36bbaf377957687db0cb3105fcf1946ab0ccc677345edd9b2c9eaf4386a3"} Jul 07 13:48:08.249342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:08.249179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" event={"ID":"f2defe31-a9e9-4617-b99b-aca566e680c8","Type":"ContainerStarted","Data":"c9d2f2afa38a0baea6d56ede7c2bb7e38c94774c1670febf5608067341d612d5"} Jul 07 13:48:08.249342 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:08.249284 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:48:08.283410 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:08.283361 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" podStartSLOduration=1.283347678 podStartE2EDuration="1.283347678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:48:08.281215359 +0000 UTC m=+1230.035625611" watchObservedRunningTime="2026-07-07 13:48:08.283347678 +0000 UTC m=+1230.037757926" Jul 07 13:48:19.255587 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:48:19.255561 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6wtn7" Jul 07 13:52:38.799542 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:52:38.799478 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:52:38.801178 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:52:38.801156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:57:38.843547 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:57:38.843510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 13:57:38.846082 ip-10-0-138-57 kubenswrapper[2565]: I0707 13:57:38.846058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:00:11.707507 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.707452 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:00:11.711120 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.711098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.714031 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.714001 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-da5db0-serving-cert\"" Jul 07 14:00:11.714165 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.714031 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v5dbl\"" Jul 07 14:00:11.726552 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.726530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:00:11.757235 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.757197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.757417 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.757249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgv6n\" (UniqueName: \"kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.757417 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.757359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.858450 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.858418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.858450 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.858454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgv6n\" (UniqueName: \"kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.858735 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.858510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.858735 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:00:11.858616 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-da5db0-serving-cert: secret "maas-api-e2e-inf-b-da5db0-serving-cert" not found Jul 07 14:00:11.858735 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:00:11.858700 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls podName:b9844f17-4c53-4c87-a086-dd9604a13bd7 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:12.358668773 +0000 UTC m=+1954.113079022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls") pod "maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" (UID: "b9844f17-4c53-4c87-a086-dd9604a13bd7") : secret "maas-api-e2e-inf-b-da5db0-serving-cert" not found Jul 07 14:00:11.859366 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.859337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:11.878699 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:11.878667 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgv6n\" (UniqueName: \"kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:12.364048 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:12.364009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:12.366799 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:12.366770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:12.622564 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:12.622530 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:12.781726 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:12.781699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:00:12.782742 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:00:12.782715 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9844f17_4c53_4c87_a086_dd9604a13bd7.slice/crio-f1ca5f610f6659554eab1e5a4a781d3ded3fd7b3dd0ade0ba8b28f9494791b7a WatchSource:0}: Error finding container f1ca5f610f6659554eab1e5a4a781d3ded3fd7b3dd0ade0ba8b28f9494791b7a: Status 404 returned error can't find the container with id f1ca5f610f6659554eab1e5a4a781d3ded3fd7b3dd0ade0ba8b28f9494791b7a Jul 07 14:00:12.784123 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:12.784102 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:00:13.090776 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:13.090695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" event={"ID":"b9844f17-4c53-4c87-a086-dd9604a13bd7","Type":"ContainerStarted","Data":"f1ca5f610f6659554eab1e5a4a781d3ded3fd7b3dd0ade0ba8b28f9494791b7a"} Jul 07 14:00:15.103851 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:15.103751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" event={"ID":"b9844f17-4c53-4c87-a086-dd9604a13bd7","Type":"ContainerStarted","Data":"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b"} Jul 07 14:00:15.104236 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:15.103869 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:00:15.127870 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:15.127823 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" podStartSLOduration=2.249227464 podStartE2EDuration="4.127809234s" totalImagesPullingTime="1.87858177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:15.126294669 +0000 UTC m=+1956.880704919" watchObservedRunningTime="2026-07-07 14:00:15.127809234 +0000 UTC m=+1956.882219482" Jul 07 14:00:21.115181 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:00:21.115147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:02:06.208319 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.208242 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:02:06.208784 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.208498 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" podUID="b9844f17-4c53-4c87-a086-dd9604a13bd7" containerName="maas-api" containerID="cri-o://f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b" gracePeriod=30 Jul 07 14:02:06.456243 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.456221 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:02:06.583931 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.583837 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgv6n\" (UniqueName: \"kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n\") pod \"b9844f17-4c53-4c87-a086-dd9604a13bd7\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " Jul 07 14:02:06.583931 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.583899 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca\") pod \"b9844f17-4c53-4c87-a086-dd9604a13bd7\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " Jul 07 14:02:06.584162 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.583942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") pod \"b9844f17-4c53-4c87-a086-dd9604a13bd7\" (UID: \"b9844f17-4c53-4c87-a086-dd9604a13bd7\") " Jul 07 14:02:06.584303 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.584269 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9844f17-4c53-4c87-a086-dd9604a13bd7" (UID: "b9844f17-4c53-4c87-a086-dd9604a13bd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:06.586392 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.586365 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n" (OuterVolumeSpecName: "kube-api-access-wgv6n") pod "b9844f17-4c53-4c87-a086-dd9604a13bd7" (UID: "b9844f17-4c53-4c87-a086-dd9604a13bd7"). InnerVolumeSpecName "kube-api-access-wgv6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:02:06.586550 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.586367 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9844f17-4c53-4c87-a086-dd9604a13bd7" (UID: "b9844f17-4c53-4c87-a086-dd9604a13bd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:02:06.684848 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.684820 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgv6n\" (UniqueName: \"kubernetes.io/projected/b9844f17-4c53-4c87-a086-dd9604a13bd7-kube-api-access-wgv6n\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:06.684848 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.684845 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9844f17-4c53-4c87-a086-dd9604a13bd7-openshift-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:06.684848 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.684855 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9844f17-4c53-4c87-a086-dd9604a13bd7-maas-api-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:06.714416 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.714383 2565 generic.go:356] "Generic (PLEG): container finished" podID="b9844f17-4c53-4c87-a086-dd9604a13bd7" containerID="f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b" exitCode=0 Jul 07 14:02:06.714563 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.714431 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" Jul 07 14:02:06.714563 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.714446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" event={"ID":"b9844f17-4c53-4c87-a086-dd9604a13bd7","Type":"ContainerDied","Data":"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b"} Jul 07 14:02:06.714563 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.714528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw" event={"ID":"b9844f17-4c53-4c87-a086-dd9604a13bd7","Type":"ContainerDied","Data":"f1ca5f610f6659554eab1e5a4a781d3ded3fd7b3dd0ade0ba8b28f9494791b7a"} Jul 07 14:02:06.714563 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.714559 2565 scope.go:117] "RemoveContainer" containerID="f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b" Jul 07 14:02:06.723934 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.723917 2565 scope.go:117] "RemoveContainer" containerID="f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b" Jul 07 14:02:06.724177 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:02:06.724157 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b\": container with ID starting with f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b not found: ID does not exist" containerID="f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b" Jul 07 14:02:06.724218 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.724185 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b"} err="failed to get container status \"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b\": rpc error: code = NotFound desc = could not find container \"f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b\": container with ID starting with f4c462cf40e82c7fefcb388012ee42c88651b198998a2f417ba0de5fbf878e3b not found: ID does not exist" Jul 07 14:02:06.738473 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.738452 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:02:06.743562 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.743526 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-da5db0-854b98d978-7vnqw"] Jul 07 14:02:06.797589 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:06.797562 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9844f17-4c53-4c87-a086-dd9604a13bd7" path="/var/lib/kubelet/pods/b9844f17-4c53-4c87-a086-dd9604a13bd7/volumes" Jul 07 14:02:17.478957 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.478920 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:17.479404 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.479335 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9844f17-4c53-4c87-a086-dd9604a13bd7" containerName="maas-api" Jul 07 14:02:17.479404 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.479346 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9844f17-4c53-4c87-a086-dd9604a13bd7" containerName="maas-api" Jul 07 14:02:17.479404 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.479401 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9844f17-4c53-4c87-a086-dd9604a13bd7" containerName="maas-api" Jul 07 14:02:17.482641 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.482623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.486914 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.486896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v5dbl\"" Jul 07 14:02:17.487333 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.487320 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-d1d8a6-serving-cert\"" Jul 07 14:02:17.497390 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.497370 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:17.583066 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.583030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.583234 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.583087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.583289 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.583228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k67f9\" (UniqueName: \"kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.684099 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.684055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k67f9\" (UniqueName: \"kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.684282 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.684133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.684282 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.684173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.684825 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.684801 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.686921 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.686898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.695730 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.695699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k67f9\" (UniqueName: \"kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9\") pod \"maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.793075 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.792989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:17.942910 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:17.942881 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:17.943814 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:02:17.943782 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73adc51_df64_4268_83a5_1e492c033ca9.slice/crio-e41bce0cdd9a4800412125f75a27367a781097c4b25a973107679b23a15870c3 WatchSource:0}: Error finding container e41bce0cdd9a4800412125f75a27367a781097c4b25a973107679b23a15870c3: Status 404 returned error can't find the container with id e41bce0cdd9a4800412125f75a27367a781097c4b25a973107679b23a15870c3 Jul 07 14:02:18.781090 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:18.780994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" event={"ID":"c73adc51-df64-4268-83a5-1e492c033ca9","Type":"ContainerStarted","Data":"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42"} Jul 07 14:02:18.781090 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:18.781052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" event={"ID":"c73adc51-df64-4268-83a5-1e492c033ca9","Type":"ContainerStarted","Data":"e41bce0cdd9a4800412125f75a27367a781097c4b25a973107679b23a15870c3"} Jul 07 14:02:18.781472 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:18.781138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:18.803585 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:18.803543 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" podStartSLOduration=1.285719562 podStartE2EDuration="1.803528693s" totalImagesPullingTime="517.809131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:18.80113917 +0000 UTC m=+2080.555549418" watchObservedRunningTime="2026-07-07 14:02:18.803528693 +0000 UTC m=+2080.557938941" Jul 07 14:02:24.803393 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:24.799570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:25.804351 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.804312 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:25.808243 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.808219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:25.812206 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.812184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-db9337-serving-cert\"" Jul 07 14:02:25.831231 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.831203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:25.962096 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.962065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl5dw\" (UniqueName: \"kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:25.962258 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.962160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:25.962258 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:25.962186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.062676 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.062587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl5dw\" (UniqueName: \"kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.062676 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.062660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.062876 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.062678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.062876 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:02:26.062801 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-db9337-serving-cert: secret "maas-api-e2e-api-b-db9337-serving-cert" not found Jul 07 14:02:26.062876 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:02:26.062862 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls podName:b0986e1d-c6a5-448a-87bc-f99ab7ac17d8 nodeName:}" failed. No retries permitted until 2026-07-07 14:02:26.562841305 +0000 UTC m=+2088.317251533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls") pod "maas-api-e2e-api-b-db9337-75749b964f-k4xgs" (UID: "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8") : secret "maas-api-e2e-api-b-db9337-serving-cert" not found Jul 07 14:02:26.063412 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.063389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.088991 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.080013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl5dw\" (UniqueName: \"kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.566550 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.566504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.569340 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.569312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") pod \"maas-api-e2e-api-b-db9337-75749b964f-k4xgs\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.720843 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.720794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:26.884624 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:26.884600 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:26.886699 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:02:26.886672 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0986e1d_c6a5_448a_87bc_f99ab7ac17d8.slice/crio-d5f775b680d9a80a0310b126c161249440bf088d7a4d60250211fcba52ac4716 WatchSource:0}: Error finding container d5f775b680d9a80a0310b126c161249440bf088d7a4d60250211fcba52ac4716: Status 404 returned error can't find the container with id d5f775b680d9a80a0310b126c161249440bf088d7a4d60250211fcba52ac4716 Jul 07 14:02:27.834524 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:27.834467 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" event={"ID":"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8","Type":"ContainerStarted","Data":"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb"} Jul 07 14:02:27.834673 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:27.834551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" event={"ID":"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8","Type":"ContainerStarted","Data":"d5f775b680d9a80a0310b126c161249440bf088d7a4d60250211fcba52ac4716"} Jul 07 14:02:27.834737 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:27.834689 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:27.885844 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:27.885798 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" podStartSLOduration=2.486157323 podStartE2EDuration="2.885783733s" totalImagesPullingTime="399.62641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:02:27.882637674 +0000 UTC m=+2089.637047923" watchObservedRunningTime="2026-07-07 14:02:27.885783733 +0000 UTC m=+2089.640193981" Jul 07 14:02:33.845082 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:33.845045 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:38.882406 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:38.882382 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:02:38.884654 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:38.884630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:02:39.888915 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:39.888881 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:39.889347 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:39.889082 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" podUID="c73adc51-df64-4268-83a5-1e492c033ca9" containerName="maas-api" containerID="cri-o://2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42" gracePeriod=30 Jul 07 14:02:40.137118 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.137093 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:40.194594 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.194528 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls\") pod \"c73adc51-df64-4268-83a5-1e492c033ca9\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " Jul 07 14:02:40.194594 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.194585 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k67f9\" (UniqueName: \"kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9\") pod \"c73adc51-df64-4268-83a5-1e492c033ca9\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " Jul 07 14:02:40.194753 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.194609 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca\") pod \"c73adc51-df64-4268-83a5-1e492c033ca9\" (UID: \"c73adc51-df64-4268-83a5-1e492c033ca9\") " Jul 07 14:02:40.195044 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.195018 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c73adc51-df64-4268-83a5-1e492c033ca9" (UID: "c73adc51-df64-4268-83a5-1e492c033ca9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:40.196735 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.196706 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c73adc51-df64-4268-83a5-1e492c033ca9" (UID: "c73adc51-df64-4268-83a5-1e492c033ca9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:02:40.196824 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.196766 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9" (OuterVolumeSpecName: "kube-api-access-k67f9") pod "c73adc51-df64-4268-83a5-1e492c033ca9" (UID: "c73adc51-df64-4268-83a5-1e492c033ca9"). InnerVolumeSpecName "kube-api-access-k67f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:02:40.295208 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.295181 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c73adc51-df64-4268-83a5-1e492c033ca9-maas-api-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:40.295208 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.295206 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k67f9\" (UniqueName: \"kubernetes.io/projected/c73adc51-df64-4268-83a5-1e492c033ca9-kube-api-access-k67f9\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:40.295356 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.295216 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c73adc51-df64-4268-83a5-1e492c033ca9-openshift-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:40.906603 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.906570 2565 generic.go:356] "Generic (PLEG): container finished" podID="c73adc51-df64-4268-83a5-1e492c033ca9" containerID="2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42" exitCode=0 Jul 07 14:02:40.907004 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.906618 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" Jul 07 14:02:40.907004 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.906651 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" event={"ID":"c73adc51-df64-4268-83a5-1e492c033ca9","Type":"ContainerDied","Data":"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42"} Jul 07 14:02:40.907004 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.906707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4" event={"ID":"c73adc51-df64-4268-83a5-1e492c033ca9","Type":"ContainerDied","Data":"e41bce0cdd9a4800412125f75a27367a781097c4b25a973107679b23a15870c3"} Jul 07 14:02:40.907004 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.906729 2565 scope.go:117] "RemoveContainer" containerID="2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42" Jul 07 14:02:40.915379 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.915361 2565 scope.go:117] "RemoveContainer" containerID="2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42" Jul 07 14:02:40.915645 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:02:40.915626 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42\": container with ID starting with 2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42 not found: ID does not exist" containerID="2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42" Jul 07 14:02:40.915707 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.915656 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42"} err="failed to get container status \"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42\": rpc error: code = NotFound desc = could not find container \"2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42\": container with ID starting with 2ba5bdcfa3e9f774ac388e8835e1acc3879e7be788b5827e4886e1d1c4c93e42 not found: ID does not exist" Jul 07 14:02:40.940450 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.940420 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:40.949654 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:40.949629 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d1d8a6-cd5974964-tc9t4"] Jul 07 14:02:42.797742 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:42.797710 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73adc51-df64-4268-83a5-1e492c033ca9" path="/var/lib/kubelet/pods/c73adc51-df64-4268-83a5-1e492c033ca9/volumes" Jul 07 14:02:50.174720 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.174689 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:50.175189 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.174903 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" podUID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" containerName="maas-api" containerID="cri-o://742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb" gracePeriod=30 Jul 07 14:02:50.430239 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.430176 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:50.591943 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.591907 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") pod \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " Jul 07 14:02:50.592125 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.591992 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca\") pod \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " Jul 07 14:02:50.592125 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.592057 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl5dw\" (UniqueName: \"kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw\") pod \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\" (UID: \"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8\") " Jul 07 14:02:50.592319 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.592296 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" (UID: "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:02:50.594329 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.594305 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" (UID: "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:02:50.594329 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.594311 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw" (OuterVolumeSpecName: "kube-api-access-gl5dw") pod "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" (UID: "b0986e1d-c6a5-448a-87bc-f99ab7ac17d8"). InnerVolumeSpecName "kube-api-access-gl5dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:02:50.693185 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.693097 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-maas-api-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:50.693185 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.693128 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-openshift-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:50.693185 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.693139 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl5dw\" (UniqueName: \"kubernetes.io/projected/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8-kube-api-access-gl5dw\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:02:50.961914 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.961823 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" containerID="742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb" exitCode=0 Jul 07 14:02:50.961914 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.961869 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" Jul 07 14:02:50.962129 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.961907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" event={"ID":"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8","Type":"ContainerDied","Data":"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb"} Jul 07 14:02:50.962129 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.961959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs" event={"ID":"b0986e1d-c6a5-448a-87bc-f99ab7ac17d8","Type":"ContainerDied","Data":"d5f775b680d9a80a0310b126c161249440bf088d7a4d60250211fcba52ac4716"} Jul 07 14:02:50.962129 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.961981 2565 scope.go:117] "RemoveContainer" containerID="742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb" Jul 07 14:02:50.972627 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.972585 2565 scope.go:117] "RemoveContainer" containerID="742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb" Jul 07 14:02:50.972915 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:02:50.972894 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb\": container with ID starting with 742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb not found: ID does not exist" containerID="742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb" Jul 07 14:02:50.973002 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:50.972925 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb"} err="failed to get container status \"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb\": rpc error: code = NotFound desc = could not find container \"742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb\": container with ID starting with 742bc742d24ec0c1e5322c2e36bb7eadc68efeb5a27635d32c3384e2eeb7dccb not found: ID does not exist" Jul 07 14:02:51.041424 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:51.041393 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:51.050373 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:51.050352 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db9337-75749b964f-k4xgs"] Jul 07 14:02:52.797500 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:02:52.797450 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" path="/var/lib/kubelet/pods/b0986e1d-c6a5-448a-87bc-f99ab7ac17d8/volumes" Jul 07 14:03:02.156251 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156219 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:03:02.156657 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156601 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73adc51-df64-4268-83a5-1e492c033ca9" containerName="maas-api" Jul 07 14:03:02.156657 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156614 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73adc51-df64-4268-83a5-1e492c033ca9" containerName="maas-api" Jul 07 14:03:02.156657 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156625 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" containerName="maas-api" Jul 07 14:03:02.156657 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156631 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" containerName="maas-api" Jul 07 14:03:02.156785 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156684 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0986e1d-c6a5-448a-87bc-f99ab7ac17d8" containerName="maas-api" Jul 07 14:03:02.156785 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.156695 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73adc51-df64-4268-83a5-1e492c033ca9" containerName="maas-api" Jul 07 14:03:02.161139 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.161120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.164705 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.164688 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v5dbl\"" Jul 07 14:03:02.164864 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.164848 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-b6630e-serving-cert\"" Jul 07 14:03:02.185769 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.185741 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:03:02.294604 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.294572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.294765 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.294706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.294765 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.294747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.395716 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.395682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.395861 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.395725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.395861 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.395760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.395861 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:03:02.395843 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-b6630e-serving-cert: secret "maas-api-e2e-shared-a-b6630e-serving-cert" not found Jul 07 14:03:02.395969 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:03:02.395914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls podName:b8511c1c-d711-4681-ac40-28a9d034dbdb nodeName:}" failed. No retries permitted until 2026-07-07 14:03:02.895892835 +0000 UTC m=+2124.650303078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls") pod "maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" (UID: "b8511c1c-d711-4681-ac40-28a9d034dbdb") : secret "maas-api-e2e-shared-a-b6630e-serving-cert" not found Jul 07 14:03:02.396335 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.396315 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.420117 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.420047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.901316 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.901278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:02.903864 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:02.903838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") pod \"maas-api-e2e-shared-a-b6630e-7fd8974b67-79687\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:03.073402 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:03.073368 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:03.250015 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:03.249978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:03:03.259852 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:03:03.259824 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8511c1c_d711_4681_ac40_28a9d034dbdb.slice/crio-a67c5211f43a0e9deaa212ff80c0ae4c278c7b7d32379c846f598e4337e1ea58 WatchSource:0}: Error finding container a67c5211f43a0e9deaa212ff80c0ae4c278c7b7d32379c846f598e4337e1ea58: Status 404 returned error can't find the container with id a67c5211f43a0e9deaa212ff80c0ae4c278c7b7d32379c846f598e4337e1ea58 Jul 07 14:03:04.033467 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:04.033381 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" event={"ID":"b8511c1c-d711-4681-ac40-28a9d034dbdb","Type":"ContainerStarted","Data":"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230"} Jul 07 14:03:04.033467 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:04.033444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" event={"ID":"b8511c1c-d711-4681-ac40-28a9d034dbdb","Type":"ContainerStarted","Data":"a67c5211f43a0e9deaa212ff80c0ae4c278c7b7d32379c846f598e4337e1ea58"} Jul 07 14:03:04.033678 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:04.033618 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:04.096463 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:04.096407 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" podStartSLOduration=1.654936782 podStartE2EDuration="2.096392289s" totalImagesPullingTime="441.455507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:04.09613044 +0000 UTC m=+2125.850540687" watchObservedRunningTime="2026-07-07 14:03:04.096392289 +0000 UTC m=+2125.850802536" Jul 07 14:03:10.043909 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:10.043878 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:03:10.974796 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:10.974766 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:03:10.978146 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:10.978122 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:10.983879 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:10.983854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-f0b1df-serving-cert\"" Jul 07 14:03:11.006082 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.006058 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:03:11.069219 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.069178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.069219 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.069216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dh7g\" (UniqueName: \"kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.069673 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.069325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.169900 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.169865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.170112 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.169907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dh7g\" (UniqueName: \"kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.170112 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:03:11.170023 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f0b1df-serving-cert: secret "maas-api-e2e-shared-b-f0b1df-serving-cert" not found Jul 07 14:03:11.170112 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.170030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.170112 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:03:11.170103 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls podName:b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f nodeName:}" failed. No retries permitted until 2026-07-07 14:03:11.670080066 +0000 UTC m=+2133.424490294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls") pod "maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" (UID: "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f") : secret "maas-api-e2e-shared-b-f0b1df-serving-cert" not found Jul 07 14:03:11.170730 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.170706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.190338 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.190311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dh7g\" (UniqueName: \"kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.675771 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.675730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.678634 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.678608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:11.888868 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:11.888837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:12.096702 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:03:12.096674 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72f99b5_cf4c_4c2f_a8ac_43e6d77e0e5f.slice/crio-a20a218ef72385fa31a3a2a2e3621ee14b1d7aee6115efc37bf723e6817be99e WatchSource:0}: Error finding container a20a218ef72385fa31a3a2a2e3621ee14b1d7aee6115efc37bf723e6817be99e: Status 404 returned error can't find the container with id a20a218ef72385fa31a3a2a2e3621ee14b1d7aee6115efc37bf723e6817be99e Jul 07 14:03:12.097948 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:12.097927 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:03:13.086904 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:13.086866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" event={"ID":"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f","Type":"ContainerStarted","Data":"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c"} Jul 07 14:03:13.087122 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:13.086925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" event={"ID":"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f","Type":"ContainerStarted","Data":"a20a218ef72385fa31a3a2a2e3621ee14b1d7aee6115efc37bf723e6817be99e"} Jul 07 14:03:13.087122 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:13.086980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:03:13.120277 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:13.120231 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" podStartSLOduration=2.649530001 podStartE2EDuration="3.120214693s" totalImagesPullingTime="470.684692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:03:13.120015927 +0000 UTC m=+2134.874426177" watchObservedRunningTime="2026-07-07 14:03:13.120214693 +0000 UTC m=+2134.874624999" Jul 07 14:03:19.097879 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:03:19.097852 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:07:38.920289 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:07:38.920260 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:07:38.924797 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:07:38.924774 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:08:32.800598 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:32.800552 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:08:32.801191 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:32.800796 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" podUID="b8511c1c-d711-4681-ac40-28a9d034dbdb" containerName="maas-api" containerID="cri-o://c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230" gracePeriod=30 Jul 07 14:08:33.048353 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.048326 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:08:33.144511 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.144460 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7\") pod \"b8511c1c-d711-4681-ac40-28a9d034dbdb\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " Jul 07 14:08:33.144680 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.144523 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca\") pod \"b8511c1c-d711-4681-ac40-28a9d034dbdb\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " Jul 07 14:08:33.144680 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.144594 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") pod \"b8511c1c-d711-4681-ac40-28a9d034dbdb\" (UID: \"b8511c1c-d711-4681-ac40-28a9d034dbdb\") " Jul 07 14:08:33.144942 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.144909 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8511c1c-d711-4681-ac40-28a9d034dbdb" (UID: "b8511c1c-d711-4681-ac40-28a9d034dbdb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:08:33.146765 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.146739 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8511c1c-d711-4681-ac40-28a9d034dbdb" (UID: "b8511c1c-d711-4681-ac40-28a9d034dbdb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:08:33.146851 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.146797 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7" (OuterVolumeSpecName: "kube-api-access-74fh7") pod "b8511c1c-d711-4681-ac40-28a9d034dbdb" (UID: "b8511c1c-d711-4681-ac40-28a9d034dbdb"). InnerVolumeSpecName "kube-api-access-74fh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:33.245468 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.245425 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8511c1c-d711-4681-ac40-28a9d034dbdb-openshift-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:33.245468 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.245462 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8511c1c-d711-4681-ac40-28a9d034dbdb-maas-api-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:33.245468 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.245473 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/b8511c1c-d711-4681-ac40-28a9d034dbdb-kube-api-access-74fh7\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:33.835040 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.835005 2565 generic.go:356] "Generic (PLEG): container finished" podID="b8511c1c-d711-4681-ac40-28a9d034dbdb" containerID="c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230" exitCode=0 Jul 07 14:08:33.835463 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.835051 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" Jul 07 14:08:33.835463 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.835100 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" event={"ID":"b8511c1c-d711-4681-ac40-28a9d034dbdb","Type":"ContainerDied","Data":"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230"} Jul 07 14:08:33.835463 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.835149 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687" event={"ID":"b8511c1c-d711-4681-ac40-28a9d034dbdb","Type":"ContainerDied","Data":"a67c5211f43a0e9deaa212ff80c0ae4c278c7b7d32379c846f598e4337e1ea58"} Jul 07 14:08:33.835463 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.835171 2565 scope.go:117] "RemoveContainer" containerID="c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230" Jul 07 14:08:33.848204 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.848186 2565 scope.go:117] "RemoveContainer" containerID="c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230" Jul 07 14:08:33.848535 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:08:33.848512 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230\": container with ID starting with c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230 not found: ID does not exist" containerID="c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230" Jul 07 14:08:33.848599 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.848548 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230"} err="failed to get container status \"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230\": rpc error: code = NotFound desc = could not find container \"c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230\": container with ID starting with c2562d33b43e3c975306b03a74d1ddf7bbfbdca3d22974aebc3a2052cd329230 not found: ID does not exist" Jul 07 14:08:33.862310 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.862286 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:08:33.867631 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:33.867605 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-b6630e-7fd8974b67-79687"] Jul 07 14:08:34.797239 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:34.797204 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8511c1c-d711-4681-ac40-28a9d034dbdb" path="/var/lib/kubelet/pods/b8511c1c-d711-4681-ac40-28a9d034dbdb/volumes" Jul 07 14:08:58.227888 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.227849 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:08:58.228351 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.228157 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" podUID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" containerName="maas-api" containerID="cri-o://ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c" gracePeriod=30 Jul 07 14:08:58.474957 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.474934 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:08:58.570795 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.570719 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") pod \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " Jul 07 14:08:58.570795 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.570751 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca\") pod \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " Jul 07 14:08:58.570795 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.570782 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dh7g\" (UniqueName: \"kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g\") pod \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\" (UID: \"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f\") " Jul 07 14:08:58.571157 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.571127 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" (UID: "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:08:58.573020 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.572995 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" (UID: "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:08:58.573158 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.573062 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g" (OuterVolumeSpecName: "kube-api-access-8dh7g") pod "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" (UID: "b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f"). InnerVolumeSpecName "kube-api-access-8dh7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:08:58.671638 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.671608 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-openshift-service-ca\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:58.671638 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.671632 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dh7g\" (UniqueName: \"kubernetes.io/projected/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-kube-api-access-8dh7g\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:58.671638 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.671642 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f-maas-api-tls\") on node \"ip-10-0-138-57.ec2.internal\" DevicePath \"\"" Jul 07 14:08:58.972890 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.972862 2565 generic.go:356] "Generic (PLEG): container finished" podID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" containerID="ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c" exitCode=0 Jul 07 14:08:58.973104 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.972924 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" Jul 07 14:08:58.973104 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.972953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" event={"ID":"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f","Type":"ContainerDied","Data":"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c"} Jul 07 14:08:58.973104 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.973015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79" event={"ID":"b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f","Type":"ContainerDied","Data":"a20a218ef72385fa31a3a2a2e3621ee14b1d7aee6115efc37bf723e6817be99e"} Jul 07 14:08:58.973104 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.973045 2565 scope.go:117] "RemoveContainer" containerID="ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c" Jul 07 14:08:58.982865 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.982850 2565 scope.go:117] "RemoveContainer" containerID="ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c" Jul 07 14:08:58.983142 ip-10-0-138-57 kubenswrapper[2565]: E0707 14:08:58.983120 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c\": container with ID starting with ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c not found: ID does not exist" containerID="ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c" Jul 07 14:08:58.983226 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.983150 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c"} err="failed to get container status \"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c\": rpc error: code = NotFound desc = could not find container \"ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c\": container with ID starting with ccc7744772f81a05210ca4f5129b051ab4b8a1287a714b7648dff1bd160e038c not found: ID does not exist" Jul 07 14:08:58.994418 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.994397 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:08:58.998922 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:08:58.998902 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f0b1df-85d9ffb89-bqd79"] Jul 07 14:09:00.798823 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:00.798788 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" path="/var/lib/kubelet/pods/b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f/volumes" Jul 07 14:09:11.088181 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:11.088151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbzzr_85124ebc-213f-42c0-8acd-676d3d6e3652/manager/0.log" Jul 07 14:09:11.472627 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:11.472597 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f9489749-wm84f_be0a73a3-a1fe-4b0e-a44d-f64f62112985/copy-manifests/0.log" Jul 07 14:09:11.489338 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:11.489311 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f9489749-wm84f_be0a73a3-a1fe-4b0e-a44d-f64f62112985/manager/0.log" Jul 07 14:09:12.387686 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.387653 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/util/0.log" Jul 07 14:09:12.394951 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.394925 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/pull/0.log" Jul 07 14:09:12.401819 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.401801 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/extract/0.log" Jul 07 14:09:12.512032 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.511999 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/util/0.log" Jul 07 14:09:12.518810 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.518784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/pull/0.log" Jul 07 14:09:12.525258 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.525222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/extract/0.log" Jul 07 14:09:12.648802 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.648728 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/util/0.log" Jul 07 14:09:12.655397 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.655375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/pull/0.log" Jul 07 14:09:12.661506 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.661466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/extract/0.log" Jul 07 14:09:12.777752 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.777720 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/util/0.log" Jul 07 14:09:12.784756 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.784732 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/pull/0.log" Jul 07 14:09:12.791849 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:12.791823 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/extract/0.log" Jul 07 14:09:13.492396 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:13.492352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6wtn7_f2defe31-a9e9-4617-b99b-aca566e680c8/manager/0.log" Jul 07 14:09:14.234259 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:14.234230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nq2ml_a9cfb7ab-ba98-4a03-a761-2f030743bbec/discovery/0.log" Jul 07 14:09:14.943368 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:14.943339 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7448b4689c-ctzmt_4f9f6acf-a05c-4334-b5fc-670fb00a5698/router/0.log" Jul 07 14:09:15.532730 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:15.532684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6pbzt_d3fe3391-cd65-4a1d-8e79-eb247723d1bd/main/0.log" Jul 07 14:09:15.649701 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:15.649671 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhvsnz_ad86ef08-179d-4efa-a32a-8e26691c01e8/main/0.log" Jul 07 14:09:22.563005 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:22.562974 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mnlfx_ccdf5162-4439-4058-90bb-89d7bd1d390d/global-pull-secret-syncer/0.log" Jul 07 14:09:22.697466 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:22.697434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c85hd_6f87d17c-bc28-457c-8f92-0a922c782a8f/konnectivity-agent/0.log" Jul 07 14:09:22.803757 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:22.803728 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-57.ec2.internal_9386b51d35694e977222ff73c9ef8b76/haproxy/0.log" Jul 07 14:09:26.428849 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.428766 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/extract/0.log" Jul 07 14:09:26.453828 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.453799 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/util/0.log" Jul 07 14:09:26.481469 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.481447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gd7bz_e8de2b54-c9b1-4465-8ec5-f8c580cf557c/pull/0.log" Jul 07 14:09:26.523418 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.523395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/extract/0.log" Jul 07 14:09:26.559267 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.559247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/util/0.log" Jul 07 14:09:26.582966 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.582950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lhktz_2ab55843-2a98-4075-9216-1ed29765fbea/pull/0.log" Jul 07 14:09:26.609693 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.609673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/extract/0.log" Jul 07 14:09:26.635279 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.635259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/util/0.log" Jul 07 14:09:26.656387 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.656368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73htktm_bc322ffc-c6b3-4c35-a580-62e18968ada9/pull/0.log" Jul 07 14:09:26.683352 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.683275 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/extract/0.log" Jul 07 14:09:26.705070 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.705041 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/util/0.log" Jul 07 14:09:26.726214 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:26.726189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vg5sv_5ece59e2-c7be-4758-963f-2e8c0cf68ff3/pull/0.log" Jul 07 14:09:27.653640 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:27.653608 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6wtn7_f2defe31-a9e9-4617-b99b-aca566e680c8/manager/0.log" Jul 07 14:09:29.534667 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.534592 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/alertmanager/0.log" Jul 07 14:09:29.558046 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.558021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/config-reloader/0.log" Jul 07 14:09:29.582396 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.582369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/kube-rbac-proxy-web/0.log" Jul 07 14:09:29.606734 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.606714 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/kube-rbac-proxy/0.log" Jul 07 14:09:29.637392 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.637370 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/kube-rbac-proxy-metric/0.log" Jul 07 14:09:29.670866 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.670844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/prom-label-proxy/0.log" Jul 07 14:09:29.695358 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.695331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_87563211-aa5e-4bfd-9b92-06af5ac8f9a7/init-config-reloader/0.log" Jul 07 14:09:29.735727 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:29.735703 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-drl7h_96c3b07c-ccf6-4743-aeb6-538acbc0f175/cluster-monitoring-operator/0.log" Jul 07 14:09:30.130697 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.130667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gl4ql_0c63576c-8535-498e-bc2b-61896ea4bee3/node-exporter/0.log" Jul 07 14:09:30.156277 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.156250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gl4ql_0c63576c-8535-498e-bc2b-61896ea4bee3/kube-rbac-proxy/0.log" Jul 07 14:09:30.179508 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.179468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gl4ql_0c63576c-8535-498e-bc2b-61896ea4bee3/init-textfile/0.log" Jul 07 14:09:30.745970 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.745937 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5684db6-ktwpw_ab72430e-39ed-443e-b1d2-7334375dd0bf/telemeter-client/0.log" Jul 07 14:09:30.790054 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.790034 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5684db6-ktwpw_ab72430e-39ed-443e-b1d2-7334375dd0bf/reload/0.log" Jul 07 14:09:30.864246 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.864208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cc5684db6-ktwpw_ab72430e-39ed-443e-b1d2-7334375dd0bf/kube-rbac-proxy/0.log" Jul 07 14:09:30.927404 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.927376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/thanos-query/0.log" Jul 07 14:09:30.981041 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:30.981012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/kube-rbac-proxy-web/0.log" Jul 07 14:09:31.009169 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:31.009107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/kube-rbac-proxy/0.log" Jul 07 14:09:31.034402 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:31.034379 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/prom-label-proxy/0.log" Jul 07 14:09:31.061376 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:31.061352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/kube-rbac-proxy-rules/0.log" Jul 07 14:09:31.088094 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:31.088072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75cc857f9c-w6hl8_0b18d614-cef1-4c4c-87ba-b2748dd486a8/kube-rbac-proxy-metrics/0.log" Jul 07 14:09:32.968248 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:32.968218 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/1.log" Jul 07 14:09:32.972690 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:32.972667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-d5dmw_2bfbeeb5-2f77-41ad-891b-9af9f80f359a/console-operator/2.log" Jul 07 14:09:33.306865 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.306791 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn"] Jul 07 14:09:33.307167 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307154 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" containerName="maas-api" Jul 07 14:09:33.307219 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307169 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" containerName="maas-api" Jul 07 14:09:33.307219 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307193 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8511c1c-d711-4681-ac40-28a9d034dbdb" containerName="maas-api" Jul 07 14:09:33.307219 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307200 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8511c1c-d711-4681-ac40-28a9d034dbdb" containerName="maas-api" Jul 07 14:09:33.307329 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307260 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8511c1c-d711-4681-ac40-28a9d034dbdb" containerName="maas-api" Jul 07 14:09:33.307329 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.307268 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72f99b5-cf4c-4c2f-a8ac-43e6d77e0e5f" containerName="maas-api" Jul 07 14:09:33.310785 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.310769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.313319 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.313296 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxg6n\"/\"kube-root-ca.crt\"" Jul 07 14:09:33.313447 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.313339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kxg6n\"/\"openshift-service-ca.crt\"" Jul 07 14:09:33.314355 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.314338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kxg6n\"/\"default-dockercfg-nkdqx\"" Jul 07 14:09:33.322396 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.322374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn"] Jul 07 14:09:33.358015 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.357986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-proc\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.358144 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.358023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wsf\" (UniqueName: \"kubernetes.io/projected/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-kube-api-access-22wsf\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.358144 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.358043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-sys\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.358144 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.358063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-podres\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.358144 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.358111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-lib-modules\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459402 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-proc\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459609 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wsf\" (UniqueName: \"kubernetes.io/projected/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-kube-api-access-22wsf\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459609 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-sys\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459609 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-podres\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459609 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-proc\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459609 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-lib-modules\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459859 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-sys\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459859 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-podres\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.459859 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.459778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-lib-modules\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.471112 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.471087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wsf\" (UniqueName: \"kubernetes.io/projected/eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8-kube-api-access-22wsf\") pod \"perf-node-gather-daemonset-x8sdn\" (UID: \"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8\") " pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.621248 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.621219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:33.755993 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:33.755967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn"] Jul 07 14:09:33.758101 ip-10-0-138-57 kubenswrapper[2565]: W0707 14:09:33.758077 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeac25b7d_5248_4ca6_bdc8_a5ccc786a6a8.slice/crio-6da443ff2bb9a2352361d85be3d70f60eb7ffdb76cc7cae816a25fdb0b6ba803 WatchSource:0}: Error finding container 6da443ff2bb9a2352361d85be3d70f60eb7ffdb76cc7cae816a25fdb0b6ba803: Status 404 returned error can't find the container with id 6da443ff2bb9a2352361d85be3d70f60eb7ffdb76cc7cae816a25fdb0b6ba803 Jul 07 14:09:34.167963 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:34.167872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" event={"ID":"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8","Type":"ContainerStarted","Data":"b715884d0c01b64a31e16538e008a19ccd17fb43433955664944ae178991bb1b"} Jul 07 14:09:34.167963 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:34.167929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" event={"ID":"eac25b7d-5248-4ca6-bdc8-a5ccc786a6a8","Type":"ContainerStarted","Data":"6da443ff2bb9a2352361d85be3d70f60eb7ffdb76cc7cae816a25fdb0b6ba803"} Jul 07 14:09:34.167963 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:34.167956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:34.186523 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:34.186456 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" podStartSLOduration=1.186438546 podStartE2EDuration="1.186438546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:34.183357235 +0000 UTC m=+2515.937767483" watchObservedRunningTime="2026-07-07 14:09:34.186438546 +0000 UTC m=+2515.940848796" Jul 07 14:09:34.186925 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:34.186909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-qk8w2_93c6a7a5-6845-40eb-b1c4-16eabb3ce3f2/volume-data-source-validator/0.log" Jul 07 14:09:35.281082 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:35.281028 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t7lt4_8fe4816a-6fed-44ce-8c7c-e2790197e7a8/dns/0.log" Jul 07 14:09:35.304603 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:35.304575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t7lt4_8fe4816a-6fed-44ce-8c7c-e2790197e7a8/kube-rbac-proxy/0.log" Jul 07 14:09:35.448065 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:35.448036 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8tn2_27a02876-7c8c-424f-a54d-b438c5e9b4fd/dns-node-resolver/0.log" Jul 07 14:09:36.047029 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:36.047000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r62wz_757215f6-580c-449d-b44e-1cdff953865d/node-ca/0.log" Jul 07 14:09:37.183542 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:37.183501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nq2ml_a9cfb7ab-ba98-4a03-a761-2f030743bbec/discovery/0.log" Jul 07 14:09:37.396728 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:37.396699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7448b4689c-ctzmt_4f9f6acf-a05c-4334-b5fc-670fb00a5698/router/0.log" Jul 07 14:09:38.129871 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.129842 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cts4l_b0a8e5c1-93e9-4671-ab5f-a6bddced9127/serve-healthcheck-canary/0.log" Jul 07 14:09:38.663230 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.663194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-srfxv_d5bb81ef-dc31-4066-baba-8a89135f44d2/insights-operator/0.log" Jul 07 14:09:38.663819 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.663803 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-srfxv_d5bb81ef-dc31-4066-baba-8a89135f44d2/insights-operator/1.log" Jul 07 14:09:38.835344 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.835321 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thgtm_aa744534-a05e-4976-b40f-b08cb5967ae5/kube-rbac-proxy/0.log" Jul 07 14:09:38.856386 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.856363 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thgtm_aa744534-a05e-4976-b40f-b08cb5967ae5/exporter/0.log" Jul 07 14:09:38.878398 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:38.878374 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thgtm_aa744534-a05e-4976-b40f-b08cb5967ae5/extractor/0.log" Jul 07 14:09:40.183975 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:40.183945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kxg6n/perf-node-gather-daemonset-x8sdn" Jul 07 14:09:41.472688 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:41.472658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbzzr_85124ebc-213f-42c0-8acd-676d3d6e3652/manager/0.log" Jul 07 14:09:41.696674 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:41.696630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f9489749-wm84f_be0a73a3-a1fe-4b0e-a44d-f64f62112985/manager/0.log" Jul 07 14:09:41.716771 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:41.716744 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76f9489749-wm84f_be0a73a3-a1fe-4b0e-a44d-f64f62112985/copy-manifests/0.log" Jul 07 14:09:42.956164 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:42.956115 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nq2ml_a9cfb7ab-ba98-4a03-a761-2f030743bbec/discovery/0.log" Jul 07 14:09:43.117002 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:43.116914 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7448b4689c-ctzmt_4f9f6acf-a05c-4334-b5fc-670fb00a5698/router/0.log" Jul 07 14:09:43.373531 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:43.373479 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dbf57879c-5ww62_dd308b2c-d695-4bea-8f74-eb202e1129c2/manager/0.log" Jul 07 14:09:44.462885 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:44.462854 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nq2ml_a9cfb7ab-ba98-4a03-a761-2f030743bbec/discovery/0.log" Jul 07 14:09:44.615066 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:44.615036 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7448b4689c-ctzmt_4f9f6acf-a05c-4334-b5fc-670fb00a5698/router/0.log" Jul 07 14:09:49.065297 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:49.065250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-h7hkn_d9d271ef-f34e-4d37-94c0-b282e06dbb1c/kube-storage-version-migrator-operator/1.log" Jul 07 14:09:49.066401 ip-10-0-138-57 kubenswrapper[2565]: I0707 14:09:49.066373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-h7hkn_d9d271ef-f34e-4d37-94c0-b282e06dbb1c/kube-storage-version-migrator-operator/0.log"