Jul 02 15:37:41.195375 ip-10-0-141-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 15:37:41.195388 ip-10-0-141-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 15:37:41.195398 ip-10-0-141-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 15:37:41.195705 ip-10-0-141-101 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 15:37:51.301031 ip-10-0-141-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 15:37:51.301052 ip-10-0-141-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1467f26cf07f4e269b546f865e3e8050 -- Jul 02 15:39:52.255523 ip-10-0-141-101 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:39:52.617248 ip-10-0-141-101 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:39:52.617248 ip-10-0-141-101 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:39:52.617248 ip-10-0-141-101 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:39:52.617248 ip-10-0-141-101 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:39:52.617248 ip-10-0-141-101 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:39:52.619043 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.618958 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:39:52.625005 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.624982 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.625005 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625002 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.625005 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625007 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.625005 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625011 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625014 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625018 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625021 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625023 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625026 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625028 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625031 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625034 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625038 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625041 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625045 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625047 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625050 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625052 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625055 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625057 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625060 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625062 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625065 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.625180 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625067 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625070 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625073 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625075 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625078 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625080 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625086 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625088 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625091 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625094 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625096 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625099 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625101 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625105 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625108 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625110 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625113 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625115 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625118 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625121 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.625934 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625123 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625126 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625128 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625131 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625133 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625136 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625138 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625141 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625143 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625146 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625148 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625150 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625153 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625155 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625158 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625160 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625162 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625165 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625168 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625170 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.626456 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625172 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625175 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625178 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625181 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625183 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625187 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625190 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625193 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625195 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625198 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625200 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625203 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625205 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625207 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625210 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625212 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625214 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625217 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625219 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.626922 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625223 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625228 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625247 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625252 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625256 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625292 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625298 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625303 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625307 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625311 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625316 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625320 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625325 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625328 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625332 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625336 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.625342 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627534 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627545 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627551 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.627678 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627557 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627562 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627566 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627571 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627575 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627579 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627583 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627587 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627591 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627595 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627600 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627603 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627607 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627611 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627616 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627620 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627624 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627629 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627633 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627637 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.628548 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627641 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627645 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627649 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627653 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627657 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627664 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627669 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627674 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627678 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627683 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627687 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627691 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627696 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627700 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627704 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627708 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627713 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627717 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.629423 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627722 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627726 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627732 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627738 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627745 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627749 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627755 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627761 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627766 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627772 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627776 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627782 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627786 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627791 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627795 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627800 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627804 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627808 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627812 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.630192 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627816 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627820 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627824 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627828 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627832 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627836 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627841 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627845 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627849 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627853 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627856 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627861 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627864 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627868 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627872 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627877 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627883 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627887 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627891 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627895 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.630806 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627899 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627903 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627907 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627916 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627921 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627925 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627929 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627933 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627937 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627941 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627946 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627950 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627954 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627958 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627963 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627968 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627973 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627977 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.627981 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628553 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628561 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.631370 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628566 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628569 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628573 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628578 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628582 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628587 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628591 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628595 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628599 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628603 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628607 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628612 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628618 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628624 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628630 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628635 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628640 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628644 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628648 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.632003 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628653 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628656 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628660 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628664 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628668 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628672 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628677 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628681 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628685 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628689 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628693 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628697 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628701 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628705 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628710 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628714 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628719 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628723 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628728 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628733 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.632551 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628737 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628741 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628745 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628749 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628753 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628757 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628761 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628765 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628771 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628774 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628779 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628783 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628786 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628790 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628794 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628799 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628803 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628807 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628811 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628815 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.633024 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628819 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628823 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628827 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628831 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628835 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628842 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628846 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628849 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628854 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628858 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628863 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628866 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628870 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628874 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628878 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628882 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628886 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628890 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628894 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.633613 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628898 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628903 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628908 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628913 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628918 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628923 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628927 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628931 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628935 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628939 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628943 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628947 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628951 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628955 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628959 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628963 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628970 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628975 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.628979 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629077 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:39:52.634063 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629088 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629097 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629107 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629113 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629117 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629124 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629130 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629135 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629140 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629145 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629150 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629155 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629159 2582 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629164 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629169 2582 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629175 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629179 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629185 2582 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629190 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629195 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629200 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629205 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629210 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:39:52.634628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629215 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629220 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629225 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629230 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629252 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629258 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629262 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629267 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629273 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629278 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629282 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629288 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629293 2582 flags.go:64] FLAG: --enable-server="true" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629298 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629306 2582 flags.go:64] FLAG: --event-burst="100" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629311 2582 flags.go:64] FLAG: --event-qps="50" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629316 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629320 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629325 2582 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629331 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629335 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629339 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629344 2582 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629348 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629353 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:39:52.635164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629358 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629363 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629367 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629372 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629376 2582 flags.go:64] FLAG: --feature-gates="" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629382 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629387 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629391 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629397 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629401 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629406 2582 flags.go:64] FLAG: --help="false" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629410 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629415 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629420 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629424 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629429 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629434 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629438 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629445 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629450 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629455 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629459 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629464 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629468 2582 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:39:52.635770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629473 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629477 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629483 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629487 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629491 2582 flags.go:64] FLAG: --lock-file="" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629496 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629500 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629506 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629515 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629521 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629525 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629530 2582 flags.go:64] FLAG: --logging-format="text" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629534 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629539 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629544 2582 flags.go:64] FLAG: --manifest-url="" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629548 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629554 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629559 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629565 2582 flags.go:64] FLAG: --max-pods="110" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629570 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629574 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629578 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629583 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629587 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629592 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:39:52.636427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629597 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629611 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629615 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629620 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629625 2582 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629630 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629637 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629642 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629646 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629651 2582 flags.go:64] FLAG: --port="10250" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629655 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629659 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ac88a9f864f7e99d" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629665 2582 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629669 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629674 2582 flags.go:64] FLAG: --register-node="true" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629678 2582 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629684 2582 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629689 2582 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629694 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629698 2582 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629703 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629708 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629713 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629717 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629721 2582 flags.go:64] FLAG: --runonce="false" Jul 02 15:39:52.637017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629726 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629731 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629735 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629740 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629744 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629750 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629754 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629759 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629765 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629772 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629776 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629781 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629785 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629790 2582 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629794 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629802 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629807 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629811 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629817 2582 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629822 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629826 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629831 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629835 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629839 2582 flags.go:64] FLAG: --v="2" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629845 2582 flags.go:64] FLAG: --version="false" Jul 02 15:39:52.637651 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629852 2582 flags.go:64] FLAG: --vmodule="" Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629858 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.629863 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630036 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630043 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630049 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630054 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630058 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630062 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630067 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630071 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630075 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630081 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630086 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630091 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630097 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630103 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630107 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630111 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.638258 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630115 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630119 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630123 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630127 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630132 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630135 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630146 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630150 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630154 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630158 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630162 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630167 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630171 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630175 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630184 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630188 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630192 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630195 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630199 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630202 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.638715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630206 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630209 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630215 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630221 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630226 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630230 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630248 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630253 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630258 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630264 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630268 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630272 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630276 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630280 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630284 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630288 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630292 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630296 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630300 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630305 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.639226 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630309 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630313 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630317 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630321 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630326 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630330 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630334 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630339 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630343 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630347 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630351 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630355 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630361 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630366 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630371 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630375 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630380 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630384 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630388 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.639726 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630392 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630396 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630402 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630406 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630410 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630414 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630418 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630421 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630425 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630429 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630434 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630438 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630442 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630445 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630449 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630453 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630457 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630461 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630465 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630469 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.640173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630473 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630478 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630482 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.630485 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.631054 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.637718 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.637736 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.638303 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.638311 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638370 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638375 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638378 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638381 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638384 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638387 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.640656 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638390 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638393 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638396 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638399 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638402 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638404 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638407 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638410 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638412 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638415 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638417 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638420 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638422 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638425 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638427 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638430 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638432 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638435 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638437 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638439 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.641019 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638442 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638444 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638447 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638457 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638459 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638462 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638465 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638467 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638470 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638472 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638475 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638477 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638480 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638482 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638485 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638487 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638490 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638492 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638494 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638497 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.641541 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638500 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638502 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638504 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638507 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638509 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638511 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638514 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638516 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638519 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638522 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638525 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638527 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638530 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638532 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638534 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638537 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638545 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638548 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638550 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638554 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.642001 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638558 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638560 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638563 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638566 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638569 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638571 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638575 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638579 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638583 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638586 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638589 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638592 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638594 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638597 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638600 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638602 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638605 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638607 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638611 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.642493 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638613 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638616 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638618 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638621 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638623 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638626 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638629 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638631 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638634 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638637 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638645 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638648 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638650 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638653 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.638657 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:39:52.642947 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638794 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638798 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638801 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638803 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638806 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638809 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638811 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638815 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638818 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638821 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638824 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638827 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638830 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638832 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638835 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638837 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638840 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638843 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638845 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:39:52.643316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638848 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638850 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638852 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638855 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638857 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638859 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638861 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638864 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638867 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638875 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638877 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638880 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638883 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638885 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638888 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638891 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638894 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638898 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638901 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:39:52.643752 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638904 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638906 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638909 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638911 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638914 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638916 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638919 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638921 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638923 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638926 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638928 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638931 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638933 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638936 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638938 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638940 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638943 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638945 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638947 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638950 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:39:52.644188 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638953 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638955 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638957 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638965 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638968 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638970 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638973 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638975 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638977 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638980 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638983 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638985 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638987 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638989 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638992 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638994 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638997 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.638999 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639001 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639004 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:39:52.644684 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639006 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639008 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639011 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639013 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639015 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639018 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639020 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639022 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639025 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639027 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639030 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639032 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639035 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639037 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639040 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639043 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639050 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639053 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639055 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639058 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:39:52.645173 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:52.639060 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.639065 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.639169 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.641108 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.642429 2582 server.go:1019] "Starting client certificate rotation" Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.642553 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.642590 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:39:52.645654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.644744 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:39:52.648922 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.648890 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:39:52.661945 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.661921 2582 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:39:52.663923 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.663907 2582 log.go:25] "Validated CRI v1 image API" Jul 02 15:39:52.664702 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.664688 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:39:52.667252 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.667207 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bb0951ed-a0c6-45e3-aebb-65823d12aaba:/dev/nvme0n1p3 d231d0e5-1ef7-4eb7-8203-06e0221d4328:/dev/nvme0n1p4] Jul 02 15:39:52.667335 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.667253 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:39:52.672402 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.672291 2582 manager.go:216] Machine: {Timestamp:2026-07-02 15:39:52.671015719 +0000 UTC m=+0.309481428 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201401 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f43c0983c7612d03225cbe33bbe2 SystemUUID:ec21f43c-0983-c761-2d03-225cbe33bbe2 BootID:1467f26c-f07f-4e26-9b54-6f865e3e8050 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:df:05:b0:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:df:05:b0:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:7c:4d:18:a0:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:39:52.672402 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.672394 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:39:52.672555 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.672531 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:39:52.674054 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.674039 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:39:52.675149 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.675127 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:39:52.675304 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.675153 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:39:52.675862 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.675853 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:39:52.675890 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.675864 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:39:52.675890 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.675871 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:39:52.676397 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.676386 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:39:52.677272 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.677263 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:39:52.680431 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680420 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:39:52.680537 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680528 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:39:52.680567 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680557 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:39:52.680567 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680566 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:39:52.680629 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680579 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:39:52.680629 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680589 2582 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:39:52.680629 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680598 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:39:52.680964 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680952 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:39:52.681017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.680973 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:39:52.685779 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.685765 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:39:52.687192 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687180 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:39:52.687247 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687208 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:39:52.687955 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687942 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:39:52.687988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687960 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:39:52.687988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687967 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:39:52.687988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687972 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:39:52.687988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687982 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:39:52.687988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.687989 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688003 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688012 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688031 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688040 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688054 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:39:52.688134 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.688060 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:39:52.689194 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.689185 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:39:52.689223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.689194 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:39:52.692623 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.692608 2582 server.go:1268] "Started kubelet" Jul 02 15:39:52.692771 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.692739 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:39:52.692901 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.692751 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:39:52.692960 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.692923 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:39:52.695043 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.695020 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:39:52.695477 ip-10-0-141-101 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:39:52.696122 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.695713 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:39:52.696122 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.695876 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:39:52.696318 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.696141 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:39:52.697419 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.697350 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:39:52.700954 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.700937 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8pfhm" Jul 02 15:39:52.702336 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.701471 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18be833b2e8cc4ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-02 15:39:52.692581631 +0000 UTC m=+0.331047339,LastTimestamp:2026-07-02 15:39:52.692581631 +0000 UTC m=+0.331047339,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}" Jul 02 15:39:52.702586 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.702570 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:39:52.702586 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.702579 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:39:52.702698 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.702626 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:39:52.702764 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.702745 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:52.703350 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703333 2582 factory.go:55] Registering systemd factory Jul 02 15:39:52.703350 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703343 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:39:52.703489 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703360 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:39:52.703489 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703350 2582 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:39:52.703489 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703346 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:39:52.703489 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703441 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:39:52.703489 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703458 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:39:52.703678 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703610 2582 factory.go:153] Registering CRI-O factory Jul 02 15:39:52.703678 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703624 2582 factory.go:223] Registration of the crio container factory successfully Jul 02 15:39:52.703678 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703670 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:39:52.703806 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703691 2582 factory.go:103] Registering Raw factory Jul 02 15:39:52.703806 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.703708 2582 manager.go:1196] Started watching for new ooms in manager Jul 02 15:39:52.704159 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.704142 2582 manager.go:349] Starting recovery of all containers Jul 02 15:39:52.706562 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.706539 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8pfhm" Jul 02 15:39:52.713559 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.713530 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 15:39:52.713690 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.713646 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 15:39:52.714336 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.714320 2582 manager.go:354] Recovery completed Jul 02 15:39:52.718110 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.718099 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.719829 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.719813 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.719887 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.719843 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.719887 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.719856 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.720306 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.720294 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:39:52.720306 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.720305 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:39:52.720388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.720319 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:39:52.720388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.720298 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.721006 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.720983 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.721079 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.721015 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.721079 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.721027 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.721356 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.721344 2582 policy_none.go:49] "None policy: Start" Jul 02 15:39:52.721394 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.721361 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:39:52.721394 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.721372 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:39:52.722527 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.722515 2582 policy_none.go:47] "Start" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.758648 2582 manager.go:337] "Starting Device Plugin manager" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.758676 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.758685 2582 server.go:87] "Starting device plugin registration server" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.758904 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.758915 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.759045 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.759113 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.759122 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.759536 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.759584 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.764734 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.765815 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.765843 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.765860 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.765895 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 15:39:52.769543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.768068 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:52.859224 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.859198 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.860117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.860099 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.860223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.860127 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.860223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.860138 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.860223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.860163 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.866597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.866580 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"] Jul 02 15:39:52.866664 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.866647 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.868033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.867970 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.868033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.867996 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.868033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.868006 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.868210 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.868194 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.868275 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.868220 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-101.ec2.internal\": node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:52.869190 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869179 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.869341 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869327 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.869429 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869356 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.869882 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869866 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.869958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869883 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.869958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869890 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.869958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869899 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.869958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869901 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.869958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.869910 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.871039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.871026 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.871110 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.871049 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:39:52.871635 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.871618 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:39:52.871708 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.871646 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:39:52.871708 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:52.871660 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:39:52.885009 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.884994 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:52.895805 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.895781 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.899141 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.899127 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal" Jul 02 15:39:52.986084 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:52.986059 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.004507 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.004489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.004579 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.004513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.004579 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.004531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6f752c07e5632ae220e7980f2a66a5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"9e6f752c07e5632ae220e7980f2a66a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.086772 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.086745 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.105108 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.105193 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105117 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.105193 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6f752c07e5632ae220e7980f2a66a5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"9e6f752c07e5632ae220e7980f2a66a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.105193 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6f752c07e5632ae220e7980f2a66a5-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"9e6f752c07e5632ae220e7980f2a66a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.105332 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.105332 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.105193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b791f2c9362604968791e0c17016617-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b791f2c9362604968791e0c17016617\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.187563 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.187490 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.197597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.197580 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.202436 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.202420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:53.287928 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.287898 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.388434 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.388408 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.488968 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.488875 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.529909 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.529879 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:53.589172 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.589150 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.641652 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.641635 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:39:53.641963 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.641775 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:39:53.641963 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.641805 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:39:53.690155 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.690118 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.712248 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.712203 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:34:53 +0000 UTC" deadline="2028-02-05 21:35:58.086688884 +0000 UTC" Jul 02 15:39:53.712352 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.712256 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13997h56m4.374460618s" Jul 02 15:39:53.739039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.738984 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:53.740823 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:53.740800 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b791f2c9362604968791e0c17016617.slice/crio-c7f91a05974951c9f3b4fc967e4ade5eee92d5ccfef8a141aab589b381350787 WatchSource:0}: Error finding container c7f91a05974951c9f3b4fc967e4ade5eee92d5ccfef8a141aab589b381350787: Status 404 returned error can't find the container with id c7f91a05974951c9f3b4fc967e4ade5eee92d5ccfef8a141aab589b381350787 Jul 02 15:39:53.746187 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.746169 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:39:53.769931 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:53.769892 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b791f2c9362604968791e0c17016617","Type":"ContainerStarted","Data":"c7f91a05974951c9f3b4fc967e4ade5eee92d5ccfef8a141aab589b381350787"} Jul 02 15:39:53.791047 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.791026 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.891669 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.891639 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:53.992149 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:53.992083 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:54.092549 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.092522 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found" Jul 02 15:39:54.173553 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.173525 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:54.203674 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.203649 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" Jul 02 15:39:54.214807 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.214772 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:39:54.215640 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.215619 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" Jul 02 15:39:54.224242 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.224215 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:39:54.681870 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.681841 2582 apiserver.go:52] "Watching apiserver" Jul 02 15:39:54.689698 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.689673 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:39:54.690796 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.690769 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-m92vz","openshift-image-registry/node-ca-rrjr4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-sp5hw","openshift-multus/network-metrics-daemon-rbfgf","openshift-network-diagnostics/network-check-target-ptmqv","kube-system/global-pull-secret-syncer-dnf8z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw","openshift-cluster-node-tuning-operator/tuned-sbwll","openshift-multus/multus-rs4vl","openshift-network-operator/iptables-alerter-qmhdv","openshift-ovn-kubernetes/ovnkube-node-fhv7x","kube-system/konnectivity-agent-spr9h","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"] Jul 02 15:39:54.693563 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.693531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.693684 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.693644 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:39:54.695808 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.695752 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.698568 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.698059 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:39:54.698568 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.698068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bb8kx\"" Jul 02 15:39:54.698568 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.698068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:39:54.698568 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.698288 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.700577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.700439 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.700577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.700459 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9hxfb\"" Jul 02 15:39:54.700577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.700484 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.700794 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.700762 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:39:54.700977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.700868 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.702752 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.702730 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.702871 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.702823 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:39:54.702871 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.702865 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4mkk\"" Jul 02 15:39:54.702998 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.702891 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.702998 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.702903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:39:54.703099 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.703055 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.703099 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.703058 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:39:54.703192 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.703168 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:39:54.703300 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.703197 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:39:54.705189 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.705168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:54.705307 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.705237 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:39:54.707588 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.707571 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.709924 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.709888 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.710019 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.709924 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7hgdj\"" Jul 02 15:39:54.710019 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.709943 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.710130 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.710111 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.712989 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.712970 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.713092 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.712988 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.713092 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713016 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fnt8b\"" Jul 02 15:39:54.713092 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713041 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.713607 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-device-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.713607 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713584 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmnh9\" (UniqueName: \"kubernetes.io/projected/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kube-api-access-rmnh9\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.713750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cnibin\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.713750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.713750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxmjh\" (UniqueName: \"kubernetes.io/projected/7202620c-7799-4d63-b697-84be2251725c-kube-api-access-dxmjh\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.713750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-dbus\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.713938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.713938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-socket-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.713938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-registration-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.713938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713887 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-system-cni-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.713938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp8k4\" (UniqueName: \"kubernetes.io/projected/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-kube-api-access-rp8k4\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.713985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-sys-fs\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-os-release\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.714147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a767b0c-e094-4c96-b7d2-6c7fc738af55-agent-certs\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a767b0c-e094-4c96-b7d2-6c7fc738af55-konnectivity-ca\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714268 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-kubelet-config\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.714443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.714380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.715169 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.715148 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-szc8w\"" Jul 02 15:39:54.715436 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.715418 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:39:54.715892 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.715858 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.716033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.715863 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.716117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.716086 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.716601 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.716579 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:39:54.718497 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.718448 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:39:54.718497 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.718458 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4h5hg\"" Jul 02 15:39:54.718674 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.718656 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.721445 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.721204 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:39:54.721445 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.721414 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.721609 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.721515 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pk28w\"" Jul 02 15:39:54.722091 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.722069 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.723475 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.723172 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.725368 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725350 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vr4zf\"" Jul 02 15:39:54.725889 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725735 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:39:54.725889 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725766 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:39:54.725889 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725777 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:39:54.726072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725899 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:39:54.726072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.725995 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:39:54.726072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.726070 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:39:54.743131 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.743106 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sh55b" Jul 02 15:39:54.755336 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.755281 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sh55b" Jul 02 15:39:54.804872 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.804848 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:39:54.815549 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-device-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.815652 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815554 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-dbus\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.815652 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-bin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.815652 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-log-socket\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-kubelet\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815666 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-device-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-os-release\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-k8s-cni-cncf-io\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-etc-kubernetes\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.815762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw4s8\" (UniqueName: \"kubernetes.io/projected/9eb504b1-f539-4e72-b213-7679fa7ae57d-kube-api-access-vw4s8\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-os-release\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815789 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9l4\" (UniqueName: \"kubernetes.io/projected/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-kube-api-access-cl9l4\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815815 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-dbus\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-sys\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-kubelet-config\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-iptables-alerter-script\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815901 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-system-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.815934 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-socket-dir-parent\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815952 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e88ecf7-fef2-466d-a01a-e1664d827f3d-kubelet-config\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.815986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-env-overrides\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-var-lib-kubelet\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816056 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-tmp-dir\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-serviceca\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-etc-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-netd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67km\" (UniqueName: \"kubernetes.io/projected/0221ebc3-f732-4ee5-a58b-6df70dc786db-kube-api-access-w67km\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-cnibin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.816308 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-systemd\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-tmp\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-cni-binary-copy\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-conf-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816494 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-binary-copy\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxmjh\" (UniqueName: \"kubernetes.io/projected/7202620c-7799-4d63-b697-84be2251725c-kube-api-access-dxmjh\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-multus-certs\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-host-slash\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-var-lib-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-bin\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816679 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816683 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysconfig\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-conf\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.816938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816741 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-socket-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816806 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovn-node-metrics-cert\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-socket-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816948 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-tuned\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.816979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a767b0c-e094-4c96-b7d2-6c7fc738af55-agent-certs\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a767b0c-e094-4c96-b7d2-6c7fc738af55-konnectivity-ca\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.817058 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5p57\" (UniqueName: \"kubernetes.io/projected/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-kube-api-access-b5p57\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-script-lib\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.817183 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:39:55.317165929 +0000 UTC m=+2.955631655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-run\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-hosts-file\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.817608 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817355 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqdd\" (UniqueName: \"kubernetes.io/projected/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-kube-api-access-zfqdd\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.817426 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817426 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-etc-selinux\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-netns\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.817462 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:39:55.317448399 +0000 UTC m=+2.955914098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-ovn\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmnh9\" (UniqueName: \"kubernetes.io/projected/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kube-api-access-rmnh9\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cnibin\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-netns\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817616 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-daemon-config\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817679 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-cnibin\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817740 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1a767b0c-e094-4c96-b7d2-6c7fc738af55-konnectivity-ca\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-host\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.818217 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-registration-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-system-cni-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp8k4\" (UniqueName: \"kubernetes.io/projected/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-kube-api-access-rp8k4\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817857 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-registration-dir\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817880 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-os-release\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817903 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-system-cni-dir\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-multus\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-slash\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.817962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-node-log\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m527m\" (UniqueName: \"kubernetes.io/projected/5e18112d-a643-4cd8-91da-c7aded43cbf7-kube-api-access-m527m\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-sys-fs\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818075 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-kubelet\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-hostroot\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818108 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2740bb7f-70a3-43bd-94a8-2d9b2379256e-sys-fs\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-systemd-units\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-config\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.818753 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-modprobe-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.819251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-kubernetes\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.819251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-host\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.819251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-systemd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.819251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.818295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-lib-modules\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.820665 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.820644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1a767b0c-e094-4c96-b7d2-6c7fc738af55-agent-certs\") pod \"konnectivity-agent-spr9h\" (UID: \"1a767b0c-e094-4c96-b7d2-6c7fc738af55\") " pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:54.823748 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.823725 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:39:54.823748 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.823748 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:39:54.823934 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.823758 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:54.823934 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:54.823809 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:39:55.323797055 +0000 UTC m=+2.962262754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:54.825742 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.825721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmnh9\" (UniqueName: \"kubernetes.io/projected/2740bb7f-70a3-43bd-94a8-2d9b2379256e-kube-api-access-rmnh9\") pod \"aws-ebs-csi-driver-node-pl2mw\" (UID: \"2740bb7f-70a3-43bd-94a8-2d9b2379256e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:54.826426 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.826407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxmjh\" (UniqueName: \"kubernetes.io/projected/7202620c-7799-4d63-b697-84be2251725c-kube-api-access-dxmjh\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:54.826607 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.826586 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp8k4\" (UniqueName: \"kubernetes.io/projected/0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384-kube-api-access-rp8k4\") pod \"multus-additional-cni-plugins-sp5hw\" (UID: \"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384\") " pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:54.889412 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:54.889382 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6f752c07e5632ae220e7980f2a66a5.slice/crio-d639042f90fc7e963a47aa177ffe254d52627684cbf4e2c351a9e165849a283b WatchSource:0}: Error finding container d639042f90fc7e963a47aa177ffe254d52627684cbf4e2c351a9e165849a283b: Status 404 returned error can't find the container with id d639042f90fc7e963a47aa177ffe254d52627684cbf4e2c351a9e165849a283b Jul 02 15:39:54.919424 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919398 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5p57\" (UniqueName: \"kubernetes.io/projected/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-kube-api-access-b5p57\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.919521 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-script-lib\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919521 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-run\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.919521 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-hosts-file\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.919521 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqdd\" (UniqueName: \"kubernetes.io/projected/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-kube-api-access-zfqdd\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-hosts-file\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-run\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-netns\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919627 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-ovn\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-netns\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919657 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-netns\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-daemon-config\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-ovn\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-netns\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.919765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-host\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919799 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-os-release\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-multus\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-slash\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919857 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-os-release\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-node-log\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919888 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-host\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m527m\" (UniqueName: \"kubernetes.io/projected/5e18112d-a643-4cd8-91da-c7aded43cbf7-kube-api-access-m527m\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919900 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-multus\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919923 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919929 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-slash\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-node-log\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-kubelet\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-hostroot\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-kubelet\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.919987 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.920455 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-systemd-units\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-config\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-modprobe-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920039 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-script-lib\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920082 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-systemd-units\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920098 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-hostroot\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-kubernetes\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-host\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920151 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-modprobe-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-systemd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-host\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920138 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-daemon-config\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-lib-modules\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920191 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-run-systemd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920214 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-kubernetes\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-bin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-log-socket\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920282 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-var-lib-cni-bin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.921376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-kubelet\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920317 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-log-socket\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-k8s-cni-cncf-io\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-kubelet\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920330 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-lib-modules\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-etc-kubernetes\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920377 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-k8s-cni-cncf-io\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw4s8\" (UniqueName: \"kubernetes.io/projected/9eb504b1-f539-4e72-b213-7679fa7ae57d-kube-api-access-vw4s8\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9l4\" (UniqueName: \"kubernetes.io/projected/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-kube-api-access-cl9l4\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920430 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-etc-kubernetes\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-sys\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-iptables-alerter-script\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-system-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-socket-dir-parent\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920498 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-sys\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-env-overrides\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-system-cni-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.922154 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-var-lib-kubelet\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920602 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovnkube-config\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920656 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-run-ovn-kubernetes\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920668 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-socket-dir-parent\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-tmp-dir\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-var-lib-kubelet\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-serviceca\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920770 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-etc-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-netd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-netd\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.920887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-etc-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921017 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w67km\" (UniqueName: \"kubernetes.io/projected/0221ebc3-f732-4ee5-a58b-6df70dc786db-kube-api-access-w67km\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0221ebc3-f732-4ee5-a58b-6df70dc786db-env-overrides\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-cnibin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921124 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-tmp-dir\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-systemd\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-tmp\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923008 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921154 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-iptables-alerter-script\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-cni-binary-copy\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-conf-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921231 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-systemd\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-d\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-multus-certs\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921290 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-cnibin\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-serviceca\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-host-slash\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-var-lib-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921371 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-multus-conf-dir\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-bin\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921392 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb504b1-f539-4e72-b213-7679fa7ae57d-host-run-multus-certs\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921410 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysconfig\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921426 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-host-slash\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-var-lib-openvswitch\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-conf\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921475 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0221ebc3-f732-4ee5-a58b-6df70dc786db-host-cni-bin\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.923669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921501 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysconfig\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovn-node-metrics-cert\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-tuned\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-sysctl-conf\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.921764 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb504b1-f539-4e72-b213-7679fa7ae57d-cni-binary-copy\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.923994 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0221ebc3-f732-4ee5-a58b-6df70dc786db-ovn-node-metrics-cert\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.924028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-tmp\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.924545 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.924060 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e18112d-a643-4cd8-91da-c7aded43cbf7-etc-tuned\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.928623 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.928601 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5p57\" (UniqueName: \"kubernetes.io/projected/bcd80b58-46d4-4b74-a10b-3c3005ff31a0-kube-api-access-b5p57\") pod \"node-resolver-m92vz\" (UID: \"bcd80b58-46d4-4b74-a10b-3c3005ff31a0\") " pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:54.928925 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.928899 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqdd\" (UniqueName: \"kubernetes.io/projected/e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32-kube-api-access-zfqdd\") pod \"node-ca-rrjr4\" (UID: \"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32\") " pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:54.929096 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.929070 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m527m\" (UniqueName: \"kubernetes.io/projected/5e18112d-a643-4cd8-91da-c7aded43cbf7-kube-api-access-m527m\") pod \"tuned-sbwll\" (UID: \"5e18112d-a643-4cd8-91da-c7aded43cbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:54.929096 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.929117 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9l4\" (UniqueName: \"kubernetes.io/projected/d2b77ff5-786a-4832-a6b4-8bee1f403fbb-kube-api-access-cl9l4\") pod \"iptables-alerter-qmhdv\" (UID: \"d2b77ff5-786a-4832-a6b4-8bee1f403fbb\") " pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:54.930184 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.930162 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67km\" (UniqueName: \"kubernetes.io/projected/0221ebc3-f732-4ee5-a58b-6df70dc786db-kube-api-access-w67km\") pod \"ovnkube-node-fhv7x\" (UID: \"0221ebc3-f732-4ee5-a58b-6df70dc786db\") " pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:54.930368 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.930351 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw4s8\" (UniqueName: \"kubernetes.io/projected/9eb504b1-f539-4e72-b213-7679fa7ae57d-kube-api-access-vw4s8\") pod \"multus-rs4vl\" (UID: \"9eb504b1-f539-4e72-b213-7679fa7ae57d\") " pod="openshift-multus/multus-rs4vl" Jul 02 15:39:54.950516 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:54.950460 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:55.007714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.007689 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:39:55.015050 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.015025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" Jul 02 15:39:55.019051 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.019030 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a767b0c_e094_4c96_b7d2_6c7fc738af55.slice/crio-7a166ebaeb0f7851a013101b0b27acaa8389f298610bf23f6570f8830142357f WatchSource:0}: Error finding container 7a166ebaeb0f7851a013101b0b27acaa8389f298610bf23f6570f8830142357f: Status 404 returned error can't find the container with id 7a166ebaeb0f7851a013101b0b27acaa8389f298610bf23f6570f8830142357f Jul 02 15:39:55.023715 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.023687 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2740bb7f_70a3_43bd_94a8_2d9b2379256e.slice/crio-13d81826d44419372c97e2d4dd57e7d3e5e0cb5ab508cd5103b494741433562b WatchSource:0}: Error finding container 13d81826d44419372c97e2d4dd57e7d3e5e0cb5ab508cd5103b494741433562b: Status 404 returned error can't find the container with id 13d81826d44419372c97e2d4dd57e7d3e5e0cb5ab508cd5103b494741433562b Jul 02 15:39:55.026571 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.026553 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" Jul 02 15:39:55.031584 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.031562 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sbwll" Jul 02 15:39:55.037750 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.037723 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4fe1e5_03ee_4cc7_81a4_a08e8bfda384.slice/crio-535a0c3889fac696bd89d0f70c55dab350721709cf7ca6f1a18c07dd87cb624a WatchSource:0}: Error finding container 535a0c3889fac696bd89d0f70c55dab350721709cf7ca6f1a18c07dd87cb624a: Status 404 returned error can't find the container with id 535a0c3889fac696bd89d0f70c55dab350721709cf7ca6f1a18c07dd87cb624a Jul 02 15:39:55.039491 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.039472 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:39:55.040803 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.040784 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e18112d_a643_4cd8_91da_c7aded43cbf7.slice/crio-2a8bb6f1e5f77eb7144b76c76bbe1871960cf677d856a9e9e2dfcd74d750f0e9 WatchSource:0}: Error finding container 2a8bb6f1e5f77eb7144b76c76bbe1871960cf677d856a9e9e2dfcd74d750f0e9: Status 404 returned error can't find the container with id 2a8bb6f1e5f77eb7144b76c76bbe1871960cf677d856a9e9e2dfcd74d750f0e9 Jul 02 15:39:55.046785 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.046765 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m92vz" Jul 02 15:39:55.050430 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.050410 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0221ebc3_f732_4ee5_a58b_6df70dc786db.slice/crio-b6814f74612a95c3e1ce4aa4c29a1f3060302129e3aba6468fc75e7a2479683f WatchSource:0}: Error finding container b6814f74612a95c3e1ce4aa4c29a1f3060302129e3aba6468fc75e7a2479683f: Status 404 returned error can't find the container with id b6814f74612a95c3e1ce4aa4c29a1f3060302129e3aba6468fc75e7a2479683f Jul 02 15:39:55.054484 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.054409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrjr4" Jul 02 15:39:55.056727 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.056704 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd80b58_46d4_4b74_a10b_3c3005ff31a0.slice/crio-10a50b9f68c4639487cba725beddd51cdae35d0490c3574ab664b20f3860d897 WatchSource:0}: Error finding container 10a50b9f68c4639487cba725beddd51cdae35d0490c3574ab664b20f3860d897: Status 404 returned error can't find the container with id 10a50b9f68c4639487cba725beddd51cdae35d0490c3574ab664b20f3860d897 Jul 02 15:39:55.062067 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.062049 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rs4vl" Jul 02 15:39:55.063821 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.063798 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c55688_3a8a_40ce_9aa6_9cd1b3fffb32.slice/crio-f09e1567aa0a3757c33a0b13d43102001ba7a5ac74ee1f125a0d750a0867a019 WatchSource:0}: Error finding container f09e1567aa0a3757c33a0b13d43102001ba7a5ac74ee1f125a0d750a0867a019: Status 404 returned error can't find the container with id f09e1567aa0a3757c33a0b13d43102001ba7a5ac74ee1f125a0d750a0867a019 Jul 02 15:39:55.067383 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.067361 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qmhdv" Jul 02 15:39:55.080243 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.080222 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb504b1_f539_4e72_b213_7679fa7ae57d.slice/crio-fb01ab55fee230042014c9c90d1cc7bff597c03a76c8ac0c6458149171d726a0 WatchSource:0}: Error finding container fb01ab55fee230042014c9c90d1cc7bff597c03a76c8ac0c6458149171d726a0: Status 404 returned error can't find the container with id fb01ab55fee230042014c9c90d1cc7bff597c03a76c8ac0c6458149171d726a0 Jul 02 15:39:55.080447 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:39:55.080430 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b77ff5_786a_4832_a6b4_8bee1f403fbb.slice/crio-7e70e38856f56d72a6f7d52674f9e963d504a2ccd5ab89c06d62826eb4cb203e WatchSource:0}: Error finding container 7e70e38856f56d72a6f7d52674f9e963d504a2ccd5ab89c06d62826eb4cb203e: Status 404 returned error can't find the container with id 7e70e38856f56d72a6f7d52674f9e963d504a2ccd5ab89c06d62826eb4cb203e Jul 02 15:39:55.325684 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.325605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:55.325684 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.325643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:55.325684 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.325665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:55.325889 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325773 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:55.325889 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325824 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:39:56.325810489 +0000 UTC m=+3.964276200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:55.325889 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325773 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:55.325990 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325901 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:39:56.325887881 +0000 UTC m=+3.964353583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:55.325990 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325775 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:39:55.325990 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325923 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:39:55.325990 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325932 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:55.325990 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.325960 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:39:56.325952847 +0000 UTC m=+3.964418544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:55.737164 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.737126 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:39:55.760376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.760313 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:34:55 +0000 UTC" deadline="2028-04-12 15:47:50.560431162 +0000 UTC" Jul 02 15:39:55.760376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.760371 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15600h7m54.800064114s" Jul 02 15:39:55.766811 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.766786 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:55.766947 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:55.766916 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:39:55.788617 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.788583 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" event={"ID":"2740bb7f-70a3-43bd-94a8-2d9b2379256e","Type":"ContainerStarted","Data":"13d81826d44419372c97e2d4dd57e7d3e5e0cb5ab508cd5103b494741433562b"} Jul 02 15:39:55.813460 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.813425 2582 generic.go:356] "Generic (PLEG): container finished" podID="9b791f2c9362604968791e0c17016617" containerID="a8936be85353570d9d6ad5b036f3ac9bb2daa579e7f1088735393a2a20790f27" exitCode=0 Jul 02 15:39:55.813611 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.813568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b791f2c9362604968791e0c17016617","Type":"ContainerDied","Data":"a8936be85353570d9d6ad5b036f3ac9bb2daa579e7f1088735393a2a20790f27"} Jul 02 15:39:55.828179 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.828143 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rs4vl" event={"ID":"9eb504b1-f539-4e72-b213-7679fa7ae57d","Type":"ContainerStarted","Data":"fb01ab55fee230042014c9c90d1cc7bff597c03a76c8ac0c6458149171d726a0"} Jul 02 15:39:55.862866 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.862828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrjr4" event={"ID":"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32","Type":"ContainerStarted","Data":"f09e1567aa0a3757c33a0b13d43102001ba7a5ac74ee1f125a0d750a0867a019"} Jul 02 15:39:55.866472 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.866351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"b6814f74612a95c3e1ce4aa4c29a1f3060302129e3aba6468fc75e7a2479683f"} Jul 02 15:39:55.870224 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.869586 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerStarted","Data":"535a0c3889fac696bd89d0f70c55dab350721709cf7ca6f1a18c07dd87cb624a"} Jul 02 15:39:55.874197 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.874171 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spr9h" event={"ID":"1a767b0c-e094-4c96-b7d2-6c7fc738af55","Type":"ContainerStarted","Data":"7a166ebaeb0f7851a013101b0b27acaa8389f298610bf23f6570f8830142357f"} Jul 02 15:39:55.881516 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.881473 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"9e6f752c07e5632ae220e7980f2a66a5","Type":"ContainerStarted","Data":"d639042f90fc7e963a47aa177ffe254d52627684cbf4e2c351a9e165849a283b"} Jul 02 15:39:55.887186 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.887160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmhdv" event={"ID":"d2b77ff5-786a-4832-a6b4-8bee1f403fbb","Type":"ContainerStarted","Data":"7e70e38856f56d72a6f7d52674f9e963d504a2ccd5ab89c06d62826eb4cb203e"} Jul 02 15:39:55.889841 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.889813 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m92vz" event={"ID":"bcd80b58-46d4-4b74-a10b-3c3005ff31a0","Type":"ContainerStarted","Data":"10a50b9f68c4639487cba725beddd51cdae35d0490c3574ab664b20f3860d897"} Jul 02 15:39:55.894366 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:55.894340 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sbwll" event={"ID":"5e18112d-a643-4cd8-91da-c7aded43cbf7","Type":"ContainerStarted","Data":"2a8bb6f1e5f77eb7144b76c76bbe1871960cf677d856a9e9e2dfcd74d750f0e9"} Jul 02 15:39:56.333312 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.333204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:56.333312 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.333278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:56.333549 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.333321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:56.333549 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.333481 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:56.333656 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.333624 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:39:58.333564688 +0000 UTC m=+5.972030401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.333866 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.333941 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:39:58.333921377 +0000 UTC m=+5.972387092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.334031 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.334050 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.334063 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:56.334182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.334104 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:39:58.334090555 +0000 UTC m=+5.972556273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:56.762098 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.761800 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:34:55 +0000 UTC" deadline="2028-03-11 22:06:36.33365579 +0000 UTC" Jul 02 15:39:56.762098 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.762060 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14838h26m39.571601523s" Jul 02 15:39:56.766213 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.766185 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:56.766398 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.766357 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:39:56.767205 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.767183 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:56.767337 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:56.767309 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:39:56.904057 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.904019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b791f2c9362604968791e0c17016617","Type":"ContainerStarted","Data":"1463b319fc012295698934bf19f68d9988ed3025efe7bdf3f25c20009cf0a75b"} Jul 02 15:39:56.920896 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:56.920835 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" podStartSLOduration=1.92081535 podStartE2EDuration="1.92081535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:39:56.920649661 +0000 UTC m=+4.559115382" watchObservedRunningTime="2026-07-02 15:39:56.92081535 +0000 UTC m=+4.559281073" Jul 02 15:39:57.766361 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:57.766328 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:57.766830 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:57.766476 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:39:58.350989 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:58.350952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:58.351014 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:58.351046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351114 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351135 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351149 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:58.351169 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351149 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:58.351531 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351207 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:02.351188791 +0000 UTC m=+9.989654505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:39:58.351531 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351229 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:40:02.351219342 +0000 UTC m=+9.989685039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:39:58.351531 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351199 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:58.351531 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.351282 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:40:02.351272982 +0000 UTC m=+9.989738681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:39:58.766787 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:58.766199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:39:58.766787 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.766369 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:39:58.767594 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:58.767430 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:39:58.767594 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:58.767549 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:39:59.766624 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:39:59.766587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:39:59.766815 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:39:59.766722 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:00.767167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:00.766784 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:00.767167 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:00.766933 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:00.767167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:00.766985 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:00.767167 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:00.767100 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:01.766653 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:01.766479 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:01.766653 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:01.766621 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:02.389422 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:02.389371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:02.389440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389568 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:02.389567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389611 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389639 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389653 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:40:10.389619123 +0000 UTC m=+18.028084826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389706 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389718 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:10.389702057 +0000 UTC m=+18.028167770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:02.389884 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.389759 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:40:10.389743232 +0000 UTC m=+18.028208930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:02.767862 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:02.767168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:02.767862 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.767299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:02.767862 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:02.767711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:02.767862 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:02.767810 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:03.766879 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:03.766839 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:03.767428 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:03.766960 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:04.766497 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:04.766461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:04.766692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:04.766461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:04.766692 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:04.766611 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:04.766692 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:04.766677 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:05.766285 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:05.766236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:05.766712 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:05.766383 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:06.766515 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:06.766480 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:06.766983 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:06.766636 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:06.766983 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:06.766693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:06.766983 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:06.766821 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:07.766743 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:07.766708 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:07.767132 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:07.766819 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:08.766354 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:08.766318 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:08.766522 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:08.766469 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:08.766609 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:08.766324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:08.766810 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:08.766786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:09.766408 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:09.766376 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:09.766602 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:09.766503 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:10.455033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:10.454997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:10.455040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:10.455069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455151 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455165 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455175 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455183 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455196 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455210 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:40:26.455195514 +0000 UTC m=+34.093661210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455225 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:40:26.455218188 +0000 UTC m=+34.093683885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:10.455410 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.455249 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:26.455230412 +0000 UTC m=+34.093696108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:10.766583 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:10.766506 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:10.766728 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:10.766507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:10.766728 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.766717 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:10.766855 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:10.766626 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:11.766180 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:11.766147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:11.766562 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:11.766269 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:12.767023 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:12.766994 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:12.767485 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:12.767121 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:12.767485 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:12.767176 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:12.767485 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:12.767284 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:13.766479 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:13.766437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:13.766624 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:13.766574 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:14.768523 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.767459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:14.768523 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:14.767592 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:14.769007 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.768528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:14.769007 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:14.768628 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:14.942499 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.942225 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrjr4" event={"ID":"e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32","Type":"ContainerStarted","Data":"9a1c93435296031cba2e1023b538d1840a66b4afa0ecc36da2b5e0afef74fb83"} Jul 02 15:40:14.943874 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.943853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"7c60b07e567221695279d9db9b3b182066b63c5e1da025ced679363e0ce4281e"} Jul 02 15:40:14.945347 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.945327 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="23528bc69840174e2cc901b307d8d19ebed2eb5246ea60f8bd1294a47c5643d6" exitCode=0 Jul 02 15:40:14.945444 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.945389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"23528bc69840174e2cc901b307d8d19ebed2eb5246ea60f8bd1294a47c5643d6"} Jul 02 15:40:14.946866 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.946840 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spr9h" event={"ID":"1a767b0c-e094-4c96-b7d2-6c7fc738af55","Type":"ContainerStarted","Data":"1c5fa1da847b231b310dcf43d6792b454b67bb823afa074d78140010dfc5ca3b"} Jul 02 15:40:14.948486 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.948439 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"9e6f752c07e5632ae220e7980f2a66a5","Type":"ContainerStarted","Data":"e97f0d01fea3082eac8b5eea6170e141255a48b38bb2da5c8b12ab7fd413abd7"} Jul 02 15:40:14.949879 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.949800 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m92vz" event={"ID":"bcd80b58-46d4-4b74-a10b-3c3005ff31a0","Type":"ContainerStarted","Data":"f66e765be6be71e0bb69b9b434a70db2c89bd7875bb729b1506c9ab8cf7c74d6"} Jul 02 15:40:14.951872 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.951849 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sbwll" event={"ID":"5e18112d-a643-4cd8-91da-c7aded43cbf7","Type":"ContainerStarted","Data":"e7a463713c844107ce5d4062af0da17035fae358fb8f627205ad0458ca7b0000"} Jul 02 15:40:14.953277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.953259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" event={"ID":"2740bb7f-70a3-43bd-94a8-2d9b2379256e","Type":"ContainerStarted","Data":"83628f955289d35bd52dc3d46652a9a3db39c9ba5988fe3cea56d8d1821ea373"} Jul 02 15:40:14.954644 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.954620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rs4vl" event={"ID":"9eb504b1-f539-4e72-b213-7679fa7ae57d","Type":"ContainerStarted","Data":"383f0246932996947ada2ebb027f7fc25884807196aa9982c135a9be8d8235bc"} Jul 02 15:40:14.956289 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.956252 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rrjr4" podStartSLOduration=2.388936065 podStartE2EDuration="21.956226347s" totalImagesPullingTime="19.567290282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:14.955961372 +0000 UTC m=+22.594427112" watchObservedRunningTime="2026-07-02 15:40:14.956226347 +0000 UTC m=+22.594692068" Jul 02 15:40:14.969194 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:14.969157 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" podStartSLOduration=19.969138679 podStartE2EDuration="19.969138679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:14.968696554 +0000 UTC m=+22.607162272" watchObservedRunningTime="2026-07-02 15:40:14.969138679 +0000 UTC m=+22.607604396" Jul 02 15:40:15.002911 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.002856 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rs4vl" podStartSLOduration=2.413185209 podStartE2EDuration="22.002834542s" totalImagesPullingTime="19.589649333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:15.002588705 +0000 UTC m=+22.641054423" watchObservedRunningTime="2026-07-02 15:40:15.002834542 +0000 UTC m=+22.641300260" Jul 02 15:40:15.016862 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.016820 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-spr9h" podStartSLOduration=11.055025792 podStartE2EDuration="22.01680183s" totalImagesPullingTime="10.961776038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:15.016064065 +0000 UTC m=+22.654529783" watchObservedRunningTime="2026-07-02 15:40:15.01680183 +0000 UTC m=+22.655267547" Jul 02 15:40:15.036022 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.035982 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sbwll" podStartSLOduration=2.448014027 podStartE2EDuration="22.035963625s" totalImagesPullingTime="19.587949598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:15.035480067 +0000 UTC m=+22.673945784" watchObservedRunningTime="2026-07-02 15:40:15.035963625 +0000 UTC m=+22.674429344" Jul 02 15:40:15.050108 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.050062 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m92vz" podStartSLOduration=2.484039163 podStartE2EDuration="22.050045618s" totalImagesPullingTime="19.566006455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:15.049717427 +0000 UTC m=+22.688183138" watchObservedRunningTime="2026-07-02 15:40:15.050045618 +0000 UTC m=+22.688511337" Jul 02 15:40:15.766954 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.766563 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:15.766954 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:15.766861 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:15.958365 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.958330 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qmhdv" event={"ID":"d2b77ff5-786a-4832-a6b4-8bee1f403fbb","Type":"ContainerStarted","Data":"1798625b95a7c2e746a378bd9d53f3b6c36e6e4f38fa28fab22a739185082a61"} Jul 02 15:40:15.961609 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.961580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"bd1d684c3e580d0ab70d236d294a6fe7fdaf660a202607a847a37ac9b23a6e41"} Jul 02 15:40:15.961729 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.961661 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"0b7bf544e049c5adb76f8cd34485dd2f3a4adce26a418b4f23826e290a3d7a22"} Jul 02 15:40:15.961729 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.961708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"3fe8e1e326cd49b7c717662e5c4333161330bd67baeb749427f567fec0d01368"} Jul 02 15:40:15.961843 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.961753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"d4b1e35e08a0e0e41d942893664edb0adb5c55447ffd10744498f3e2a2f56cfd"} Jul 02 15:40:15.961843 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:15.961802 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"d4b7d229da19c794278d11ec36d4f132de7711cb8fe74bc02729cb5db642df4b"} Jul 02 15:40:16.300737 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.300711 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:40:16.766701 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.766669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:16.766701 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.766693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:16.766922 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:16.766805 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:16.766985 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:16.766939 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:16.768295 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.768168 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:40:16.300732469Z","UUID":"e1f6cff3-62de-442f-b049-80d0fdb50414","Handler":null,"Name":"","Endpoint":""} Jul 02 15:40:16.769978 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.769956 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:40:16.770087 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.769998 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:40:16.966645 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.966609 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" event={"ID":"2740bb7f-70a3-43bd-94a8-2d9b2379256e","Type":"ContainerStarted","Data":"fba3157b4fe8ea85fd81fa1e376702ef79c8905ec9d2e6ae0c2aee722fb95be5"} Jul 02 15:40:16.982931 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:16.982883 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qmhdv" podStartSLOduration=8.420426868 podStartE2EDuration="23.982864011s" totalImagesPullingTime="15.562437143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:16.982762487 +0000 UTC m=+24.621228205" watchObservedRunningTime="2026-07-02 15:40:16.982864011 +0000 UTC m=+24.621329732" Jul 02 15:40:17.766376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:17.766306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:17.766536 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:17.766423 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:18.766338 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:18.766296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:18.766805 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:18.766345 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:18.766805 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:18.766448 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:18.766805 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:18.766572 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:19.186129 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.186096 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:40:19.186735 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.186718 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:40:19.766355 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.766182 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:19.766690 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:19.766429 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:19.976047 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.976014 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"c1361fb78f7d7f10366a89a803c77e0456f563abf9766e36fb2a865fee885af0"} Jul 02 15:40:19.977686 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.977664 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="de603b9341152a5d523044f8f102b3d0a3db7202b852952aab370cb5040869ee" exitCode=0 Jul 02 15:40:19.977793 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.977713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"de603b9341152a5d523044f8f102b3d0a3db7202b852952aab370cb5040869ee"} Jul 02 15:40:19.979858 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:19.979836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" event={"ID":"2740bb7f-70a3-43bd-94a8-2d9b2379256e","Type":"ContainerStarted","Data":"cfa2c9810663ea7c1b8e177a5efa3edfd496717dc59fdf10d05d33bc835e7d7b"} Jul 02 15:40:20.017983 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:20.017911 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pl2mw" podStartSLOduration=3.478048058 podStartE2EDuration="27.017897653s" totalImagesPullingTime="23.539849595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:20.017394551 +0000 UTC m=+27.655860269" watchObservedRunningTime="2026-07-02 15:40:20.017897653 +0000 UTC m=+27.656363370" Jul 02 15:40:20.766417 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:20.766391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:20.766417 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:20.766392 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:20.766936 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:20.766534 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:20.766936 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:20.766566 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:21.766789 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.766760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:21.767447 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:21.766868 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:21.987568 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.987304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" event={"ID":"0221ebc3-f732-4ee5-a58b-6df70dc786db","Type":"ContainerStarted","Data":"15ab958340796db3e486ba3e166a8ddc5a66914dfcf3265955ef543c9927688c"} Jul 02 15:40:21.987816 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.987608 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:21.987816 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.987658 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:21.989443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.989420 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="65135c1dc0650730ea9d03a9373ccd3c6abff0212b3fb92761c1cf5156232510" exitCode=0 Jul 02 15:40:21.989554 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:21.989457 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"65135c1dc0650730ea9d03a9373ccd3c6abff0212b3fb92761c1cf5156232510"} Jul 02 15:40:22.003504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:22.003484 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:22.013259 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:22.013208 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" podStartSLOduration=9.340908253 podStartE2EDuration="29.013194969s" totalImagesPullingTime="19.672286716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:22.012647373 +0000 UTC m=+29.651113101" watchObservedRunningTime="2026-07-02 15:40:22.013194969 +0000 UTC m=+29.651660686" Jul 02 15:40:22.766931 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:22.766903 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:22.767346 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:22.767001 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:22.767346 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:22.767009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:22.767346 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:22.767125 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:22.992327 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:22.992294 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:23.014268 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.014228 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:23.223028 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.222995 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dnf8z"] Jul 02 15:40:23.223202 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.223124 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:23.223290 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:23.223229 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:23.223761 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.223737 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ptmqv"] Jul 02 15:40:23.223876 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.223831 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:23.223939 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:23.223919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:23.225976 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.225952 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbfgf"] Jul 02 15:40:23.226078 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.226041 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:23.226132 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:23.226115 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:23.441671 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.441641 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:40:23.441849 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.441748 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 15:40:23.442310 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.442292 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-spr9h" Jul 02 15:40:23.995774 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.995747 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="b562a52d8e3ad72925f468076686fdd1331e9acc5442cc1c5e65286c817684e3" exitCode=0 Jul 02 15:40:23.996159 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:23.995834 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"b562a52d8e3ad72925f468076686fdd1331e9acc5442cc1c5e65286c817684e3"} Jul 02 15:40:24.766971 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:24.766932 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:24.767166 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:24.766936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:24.767166 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:24.767055 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:24.767166 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:24.766950 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:24.767166 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:24.767134 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:24.767455 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:24.767218 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:26.481683 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.481648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.481695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481803 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481824 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481835 2582 projected.go:196] Error preparing data for projected volume kube-api-access-kb7hc for pod openshift-network-diagnostics/network-check-target-ptmqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481844 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481879 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc podName:f0388d88-6126-4ed0-b370-52602d20e634 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:58.481864739 +0000 UTC m=+66.120330435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kb7hc" (UniqueName: "kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc") pod "network-check-target-ptmqv" (UID: "f0388d88-6126-4ed0-b370-52602d20e634") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481895 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs podName:7202620c-7799-4d63-b697-84be2251725c nodeName:}" failed. No retries permitted until 2026-07-02 15:40:58.481888621 +0000 UTC m=+66.120354317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs") pod "network-metrics-daemon-rbfgf" (UID: "7202620c-7799-4d63-b697-84be2251725c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.481910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.481995 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:26.482035 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.482021 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret podName:3e88ecf7-fef2-466d-a01a-e1664d827f3d nodeName:}" failed. No retries permitted until 2026-07-02 15:40:58.482015108 +0000 UTC m=+66.120480804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret") pod "global-pull-secret-syncer-dnf8z" (UID: "3e88ecf7-fef2-466d-a01a-e1664d827f3d") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:40:26.766563 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.766333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:26.766742 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.766333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:26.766742 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.766623 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbfgf" podUID="7202620c-7799-4d63-b697-84be2251725c" Jul 02 15:40:26.766742 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:26.766334 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:26.766742 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.766670 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ptmqv" podUID="f0388d88-6126-4ed0-b370-52602d20e634" Jul 02 15:40:26.766928 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:26.766790 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dnf8z" podUID="3e88ecf7-fef2-466d-a01a-e1664d827f3d" Jul 02 15:40:27.721208 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.721182 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeReady" Jul 02 15:40:27.721628 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.721336 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:40:27.757262 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.757213 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:40:27.759873 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.759847 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.765145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.765119 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6pc66\"" Jul 02 15:40:27.765302 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.765230 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 15:40:27.765435 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.765393 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 15:40:27.765561 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.765469 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 15:40:27.771766 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.771743 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 15:40:27.777838 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.777414 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2tdgp"] Jul 02 15:40:27.781211 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.781186 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:40:27.781327 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.781310 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.783688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.783667 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:40:27.783688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.783682 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:40:27.783845 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.783704 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hz9jz\"" Jul 02 15:40:27.785869 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.785850 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7d7mt"] Jul 02 15:40:27.787692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.787538 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.789959 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.789943 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:40:27.790214 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.790200 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ggszz\"" Jul 02 15:40:27.790314 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.790255 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:40:27.790379 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.790330 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:40:27.794085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.794037 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2tdgp"] Jul 02 15:40:27.798507 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.798485 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7d7mt"] Jul 02 15:40:27.892973 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.892937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbd9c\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893153 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.892989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-cert\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.893153 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqkw\" (UniqueName: \"kubernetes.io/projected/cbd0fa6a-2d3b-491f-8e9b-398640396146-kube-api-access-zdqkw\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.893153 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893153 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893153 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd0fa6a-2d3b-491f-8e9b-398640396146-tmp-dir\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.893385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.893579 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd0fa6a-2d3b-491f-8e9b-398640396146-config-volume\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.893579 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.893452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghwd\" (UniqueName: \"kubernetes.io/projected/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-kube-api-access-nghwd\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.994184 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994284 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994348 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994348 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:27.994329 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:40:27.994348 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:27.994346 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bc9d9465-pkkq6: secret "image-registry-tls" not found Jul 02 15:40:27.994477 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.994477 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994477 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:27.994411 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls podName:3fda9c87-a5f1-4784-b959-92110ad3ee60 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:28.494391003 +0000 UTC m=+36.132856716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls") pod "image-registry-78bc9d9465-pkkq6" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60") : secret "image-registry-tls" not found Jul 02 15:40:27.994477 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994477 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:27.994487 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd0fa6a-2d3b-491f-8e9b-398640396146-tmp-dir\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:27.994529 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls podName:cbd0fa6a-2d3b-491f-8e9b-398640396146 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:28.494515803 +0000 UTC m=+36.132981503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls") pod "dns-default-2tdgp" (UID: "cbd0fa6a-2d3b-491f-8e9b-398640396146") : secret "dns-default-metrics-tls" not found Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd0fa6a-2d3b-491f-8e9b-398640396146-config-volume\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghwd\" (UniqueName: \"kubernetes.io/projected/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-kube-api-access-nghwd\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbd9c\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-cert\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.994712 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqkw\" (UniqueName: \"kubernetes.io/projected/cbd0fa6a-2d3b-491f-8e9b-398640396146-kube-api-access-zdqkw\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.995113 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbd0fa6a-2d3b-491f-8e9b-398640396146-tmp-dir\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.995113 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.995113 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.994907 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.995298 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.995271 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.995555 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.995534 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbd0fa6a-2d3b-491f-8e9b-398640396146-config-volume\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:27.998868 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.998841 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:27.998963 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.998875 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-cert\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:27.998963 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:27.998882 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:28.002908 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.002420 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:28.002908 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.002481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqkw\" (UniqueName: \"kubernetes.io/projected/cbd0fa6a-2d3b-491f-8e9b-398640396146-kube-api-access-zdqkw\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:28.005481 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.005442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghwd\" (UniqueName: \"kubernetes.io/projected/ea79554b-e4d3-4a85-8eb0-fb2d271d359f-kube-api-access-nghwd\") pod \"ingress-canary-7d7mt\" (UID: \"ea79554b-e4d3-4a85-8eb0-fb2d271d359f\") " pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:28.005936 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.005912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbd9c\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:28.098942 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.098910 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7d7mt" Jul 02 15:40:28.233423 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.233196 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7d7mt"] Jul 02 15:40:28.236731 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:28.236699 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea79554b_e4d3_4a85_8eb0_fb2d271d359f.slice/crio-fb6729fc04643cd1d3f92c975143bd37912e6cbee5f67ad7c8cef31455ab8305 WatchSource:0}: Error finding container fb6729fc04643cd1d3f92c975143bd37912e6cbee5f67ad7c8cef31455ab8305: Status 404 returned error can't find the container with id fb6729fc04643cd1d3f92c975143bd37912e6cbee5f67ad7c8cef31455ab8305 Jul 02 15:40:28.499554 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.499460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:28.499554 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.499500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:28.499706 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:28.499588 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:40:28.499706 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:28.499638 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls podName:cbd0fa6a-2d3b-491f-8e9b-398640396146 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:29.499622814 +0000 UTC m=+37.138088517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls") pod "dns-default-2tdgp" (UID: "cbd0fa6a-2d3b-491f-8e9b-398640396146") : secret "dns-default-metrics-tls" not found Jul 02 15:40:28.499706 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:28.499650 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:40:28.499706 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:28.499669 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bc9d9465-pkkq6: secret "image-registry-tls" not found Jul 02 15:40:28.499831 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:28.499715 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls podName:3fda9c87-a5f1-4784-b959-92110ad3ee60 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:29.499698547 +0000 UTC m=+37.138164265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls") pod "image-registry-78bc9d9465-pkkq6" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60") : secret "image-registry-tls" not found Jul 02 15:40:28.767207 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.767131 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:28.767939 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.767134 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:28.767939 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.767132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769743 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769743 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgwjj\"" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769833 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xd9rd\"" Jul 02 15:40:28.770083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:28.769941 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:40:29.010195 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:29.010163 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="07d35acf7291a4aa653c08c50a407dc70f5949139834ac8779fab6caaafd1fc6" exitCode=0 Jul 02 15:40:29.010369 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:29.010275 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"07d35acf7291a4aa653c08c50a407dc70f5949139834ac8779fab6caaafd1fc6"} Jul 02 15:40:29.011525 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:29.011497 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7d7mt" event={"ID":"ea79554b-e4d3-4a85-8eb0-fb2d271d359f","Type":"ContainerStarted","Data":"fb6729fc04643cd1d3f92c975143bd37912e6cbee5f67ad7c8cef31455ab8305"} Jul 02 15:40:29.507055 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:29.507022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:29.507257 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:29.507065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:29.507257 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:29.507185 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:40:29.507257 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:29.507210 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:40:29.507257 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:29.507229 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bc9d9465-pkkq6: secret "image-registry-tls" not found Jul 02 15:40:29.507415 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:29.507261 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls podName:cbd0fa6a-2d3b-491f-8e9b-398640396146 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:31.507226962 +0000 UTC m=+39.145692658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls") pod "dns-default-2tdgp" (UID: "cbd0fa6a-2d3b-491f-8e9b-398640396146") : secret "dns-default-metrics-tls" not found Jul 02 15:40:29.507415 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:29.507297 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls podName:3fda9c87-a5f1-4784-b959-92110ad3ee60 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:31.507282456 +0000 UTC m=+39.145748152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls") pod "image-registry-78bc9d9465-pkkq6" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60") : secret "image-registry-tls" not found Jul 02 15:40:30.016762 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:30.016730 2582 generic.go:356] "Generic (PLEG): container finished" podID="0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384" containerID="0ce1872bd4c657395bb0c96e16aea6bb7aa9e79804b52c2b2a79ac0a74e8feae" exitCode=0 Jul 02 15:40:30.017229 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:30.016784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerDied","Data":"0ce1872bd4c657395bb0c96e16aea6bb7aa9e79804b52c2b2a79ac0a74e8feae"} Jul 02 15:40:31.021694 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:31.021625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" event={"ID":"0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384","Type":"ContainerStarted","Data":"c78d06bf3cbe3c6bfb6003852fb3fe8e338fb912da0fe9406420330798742ba7"} Jul 02 15:40:31.057807 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:31.057769 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sp5hw" podStartSLOduration=12.020722365 podStartE2EDuration="38.0577512s" totalImagesPullingTime="26.037028835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:31.05634551 +0000 UTC m=+38.694811228" watchObservedRunningTime="2026-07-02 15:40:31.0577512 +0000 UTC m=+38.696216918" Jul 02 15:40:31.520017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:31.519983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:31.520017 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:31.520024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:31.520215 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:31.520139 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:40:31.520215 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:31.520155 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:40:31.520215 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:31.520176 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bc9d9465-pkkq6: secret "image-registry-tls" not found Jul 02 15:40:31.520215 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:31.520196 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls podName:cbd0fa6a-2d3b-491f-8e9b-398640396146 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:35.520180597 +0000 UTC m=+43.158646294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls") pod "dns-default-2tdgp" (UID: "cbd0fa6a-2d3b-491f-8e9b-398640396146") : secret "dns-default-metrics-tls" not found Jul 02 15:40:31.520372 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:31.520227 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls podName:3fda9c87-a5f1-4784-b959-92110ad3ee60 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:35.520210968 +0000 UTC m=+43.158676680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls") pod "image-registry-78bc9d9465-pkkq6" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60") : secret "image-registry-tls" not found Jul 02 15:40:32.025406 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:32.025371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7d7mt" event={"ID":"ea79554b-e4d3-4a85-8eb0-fb2d271d359f","Type":"ContainerStarted","Data":"87635281ec5992c9138b021e0fa11723a434c2d427cc388e0f9b2a51a376c06e"} Jul 02 15:40:32.047353 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:32.047310 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7d7mt" podStartSLOduration=2.228593101 podStartE2EDuration="5.047294329s" totalImagesPullingTime="2.818701228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:32.046869133 +0000 UTC m=+39.685334851" watchObservedRunningTime="2026-07-02 15:40:32.047294329 +0000 UTC m=+39.685760056" Jul 02 15:40:35.549357 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:35.549319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:35.549357 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:35.549363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:35.549757 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:35.549467 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:40:35.549757 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:35.549473 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:40:35.549757 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:35.549539 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bc9d9465-pkkq6: secret "image-registry-tls" not found Jul 02 15:40:35.549757 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:35.549543 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls podName:cbd0fa6a-2d3b-491f-8e9b-398640396146 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:43.549525301 +0000 UTC m=+51.187991013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls") pod "dns-default-2tdgp" (UID: "cbd0fa6a-2d3b-491f-8e9b-398640396146") : secret "dns-default-metrics-tls" not found Jul 02 15:40:35.549757 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:35.549574 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls podName:3fda9c87-a5f1-4784-b959-92110ad3ee60 nodeName:}" failed. No retries permitted until 2026-07-02 15:40:43.549563513 +0000 UTC m=+51.188029224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls") pod "image-registry-78bc9d9465-pkkq6" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60") : secret "image-registry-tls" not found Jul 02 15:40:43.609443 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.609407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:43.609991 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.609451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:43.613108 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.613079 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbd0fa6a-2d3b-491f-8e9b-398640396146-metrics-tls\") pod \"dns-default-2tdgp\" (UID: \"cbd0fa6a-2d3b-491f-8e9b-398640396146\") " pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:43.613306 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.613170 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"image-registry-78bc9d9465-pkkq6\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:43.673226 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.673196 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:43.690409 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.690383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:43.845325 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.845298 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:40:43.849085 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:43.849059 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fda9c87_a5f1_4784_b959_92110ad3ee60.slice/crio-86e2a5baa641b1f7632e5bc0a0cf5706f40983cc1f53ba5041449652d9fd3a32 WatchSource:0}: Error finding container 86e2a5baa641b1f7632e5bc0a0cf5706f40983cc1f53ba5041449652d9fd3a32: Status 404 returned error can't find the container with id 86e2a5baa641b1f7632e5bc0a0cf5706f40983cc1f53ba5041449652d9fd3a32 Jul 02 15:40:43.875757 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:43.875701 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2tdgp"] Jul 02 15:40:43.878489 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:43.878462 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd0fa6a_2d3b_491f_8e9b_398640396146.slice/crio-a884211e388eb19899ec62331b8b3668d0a837321d3d21d156f9a78c2adcefe9 WatchSource:0}: Error finding container a884211e388eb19899ec62331b8b3668d0a837321d3d21d156f9a78c2adcefe9: Status 404 returned error can't find the container with id a884211e388eb19899ec62331b8b3668d0a837321d3d21d156f9a78c2adcefe9 Jul 02 15:40:44.055229 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:44.055189 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tdgp" event={"ID":"cbd0fa6a-2d3b-491f-8e9b-398640396146","Type":"ContainerStarted","Data":"a884211e388eb19899ec62331b8b3668d0a837321d3d21d156f9a78c2adcefe9"} Jul 02 15:40:44.056600 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:44.056574 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" event={"ID":"3fda9c87-a5f1-4784-b959-92110ad3ee60","Type":"ContainerStarted","Data":"c80a077025b0fec4c844cc771aa6bb092a985bca6094acdec69e43cdb2489c4f"} Jul 02 15:40:44.056713 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:44.056615 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" event={"ID":"3fda9c87-a5f1-4784-b959-92110ad3ee60","Type":"ContainerStarted","Data":"86e2a5baa641b1f7632e5bc0a0cf5706f40983cc1f53ba5041449652d9fd3a32"} Jul 02 15:40:44.056713 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:44.056707 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:40:44.076676 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:44.076633 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" podStartSLOduration=61.076621494 podStartE2EDuration="1m1.076621494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:44.076485408 +0000 UTC m=+51.714951121" watchObservedRunningTime="2026-07-02 15:40:44.076621494 +0000 UTC m=+51.715087191" Jul 02 15:40:47.066415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:47.066333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tdgp" event={"ID":"cbd0fa6a-2d3b-491f-8e9b-398640396146","Type":"ContainerStarted","Data":"13d0201da58aad7139977519bff7fc8f9eb2eeb84e9b902968afd8bff88e1828"} Jul 02 15:40:47.066415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:47.066391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tdgp" event={"ID":"cbd0fa6a-2d3b-491f-8e9b-398640396146","Type":"ContainerStarted","Data":"d223bdf7500b9260d806f972f11360bd860fff753dd093357ea9487f425c521b"} Jul 02 15:40:47.066804 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:47.066459 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:47.087616 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:47.085352 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2tdgp" podStartSLOduration=17.204043951 podStartE2EDuration="20.085333432s" totalImagesPullingTime="2.881289481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:47.084803853 +0000 UTC m=+54.723269576" watchObservedRunningTime="2026-07-02 15:40:47.085333432 +0000 UTC m=+54.723799152" Jul 02 15:40:55.009297 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.009269 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fhv7x" Jul 02 15:40:55.613496 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.613461 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch"] Jul 02 15:40:55.616546 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.616508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.617613 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.617533 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8m66"] Jul 02 15:40:55.621301 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.619910 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.621301 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.620938 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ghzkc\"" Jul 02 15:40:55.621301 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.621226 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:40:55.621824 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.621523 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:40:55.621824 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.621618 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 15:40:55.621824 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.621777 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 15:40:55.626493 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.626472 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 15:40:55.626844 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.626824 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 15:40:55.627570 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.627552 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:40:55.627729 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.627711 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:40:55.627807 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.627794 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8xmt4\"" Jul 02 15:40:55.632415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.632392 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch"] Jul 02 15:40:55.632758 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.632743 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 15:40:55.636547 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.636526 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8m66"] Jul 02 15:40:55.684606 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.684571 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:40:55.692493 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ebc93b26-7002-4e08-b02f-43e43306f770-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.692637 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bhz\" (UniqueName: \"kubernetes.io/projected/ebc93b26-7002-4e08-b02f-43e43306f770-kube-api-access-44bhz\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.692637 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6734c282-b9b3-4872-9753-afe860adfb32-serving-cert\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.692637 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebc93b26-7002-4e08-b02f-43e43306f770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.692752 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.692752 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692661 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-snapshots\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.692752 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-tmp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.692752 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.692918 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.692813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzkwp\" (UniqueName: \"kubernetes.io/projected/6734c282-b9b3-4872-9753-afe860adfb32-kube-api-access-rzkwp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794048 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-snapshots\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-tmp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzkwp\" (UniqueName: \"kubernetes.io/projected/6734c282-b9b3-4872-9753-afe860adfb32-kube-api-access-rzkwp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ebc93b26-7002-4e08-b02f-43e43306f770-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bhz\" (UniqueName: \"kubernetes.io/projected/ebc93b26-7002-4e08-b02f-43e43306f770-kube-api-access-44bhz\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.794277 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6734c282-b9b3-4872-9753-afe860adfb32-serving-cert\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebc93b26-7002-4e08-b02f-43e43306f770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.794585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794686 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794651 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-tmp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.794772 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.794751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6734c282-b9b3-4872-9753-afe860adfb32-snapshots\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.795093 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.795075 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ebc93b26-7002-4e08-b02f-43e43306f770-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.795181 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.795110 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-service-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.795370 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.795261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6734c282-b9b3-4872-9753-afe860adfb32-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.796808 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.796779 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebc93b26-7002-4e08-b02f-43e43306f770-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.796808 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.796803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6734c282-b9b3-4872-9753-afe860adfb32-serving-cert\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.806649 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.806626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzkwp\" (UniqueName: \"kubernetes.io/projected/6734c282-b9b3-4872-9753-afe860adfb32-kube-api-access-rzkwp\") pod \"insights-operator-5f67b55555-s8m66\" (UID: \"6734c282-b9b3-4872-9753-afe860adfb32\") " pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:55.812433 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.812406 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bhz\" (UniqueName: \"kubernetes.io/projected/ebc93b26-7002-4e08-b02f-43e43306f770-kube-api-access-44bhz\") pod \"cluster-monitoring-operator-54cb84584-x7tch\" (UID: \"ebc93b26-7002-4e08-b02f-43e43306f770\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.932985 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.932877 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" Jul 02 15:40:55.939023 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:55.939005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-s8m66" Jul 02 15:40:56.065173 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:56.065142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch"] Jul 02 15:40:56.069639 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:56.069612 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc93b26_7002_4e08_b02f_43e43306f770.slice/crio-e1237ab671f86a0f48315fcfe3a8a15fea51db475143b5c78688e0249a2e24ed WatchSource:0}: Error finding container e1237ab671f86a0f48315fcfe3a8a15fea51db475143b5c78688e0249a2e24ed: Status 404 returned error can't find the container with id e1237ab671f86a0f48315fcfe3a8a15fea51db475143b5c78688e0249a2e24ed Jul 02 15:40:56.088179 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:56.088151 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-s8m66"] Jul 02 15:40:56.088632 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:56.088602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" event={"ID":"ebc93b26-7002-4e08-b02f-43e43306f770","Type":"ContainerStarted","Data":"e1237ab671f86a0f48315fcfe3a8a15fea51db475143b5c78688e0249a2e24ed"} Jul 02 15:40:56.091110 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:56.091090 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6734c282_b9b3_4872_9753_afe860adfb32.slice/crio-fd419698fc6e926c1fe29de5f8c3720b47e422582fa66cec1e9f6d8d7dcb0f9e WatchSource:0}: Error finding container fd419698fc6e926c1fe29de5f8c3720b47e422582fa66cec1e9f6d8d7dcb0f9e: Status 404 returned error can't find the container with id fd419698fc6e926c1fe29de5f8c3720b47e422582fa66cec1e9f6d8d7dcb0f9e Jul 02 15:40:57.070926 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:57.070897 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2tdgp" Jul 02 15:40:57.092072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:57.092036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8m66" event={"ID":"6734c282-b9b3-4872-9753-afe860adfb32","Type":"ContainerStarted","Data":"fd419698fc6e926c1fe29de5f8c3720b47e422582fa66cec1e9f6d8d7dcb0f9e"} Jul 02 15:40:58.518663 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.518560 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:58.518663 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.518623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:58.518663 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.518655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:58.521204 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.521172 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:40:58.521899 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.521881 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:40:58.521987 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.521881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:40:58.531345 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.531264 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:40:58.531512 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.531489 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e88ecf7-fef2-466d-a01a-e1664d827f3d-original-pull-secret\") pod \"global-pull-secret-syncer-dnf8z\" (UID: \"3e88ecf7-fef2-466d-a01a-e1664d827f3d\") " pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:58.531846 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.531822 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7202620c-7799-4d63-b697-84be2251725c-metrics-certs\") pod \"network-metrics-daemon-rbfgf\" (UID: \"7202620c-7799-4d63-b697-84be2251725c\") " pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:58.541965 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.541936 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb7hc\" (UniqueName: \"kubernetes.io/projected/f0388d88-6126-4ed0-b370-52602d20e634-kube-api-access-kb7hc\") pod \"network-check-target-ptmqv\" (UID: \"f0388d88-6126-4ed0-b370-52602d20e634\") " pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:58.610726 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.610692 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2"] Jul 02 15:40:58.613226 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.613203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:40:58.615479 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.615444 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 15:40:58.615593 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.615534 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jgx6w\"" Jul 02 15:40:58.625896 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.625871 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2"] Jul 02 15:40:58.720445 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.720408 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3d222f90-1ccf-476c-a0bb-0f784a6d9aae-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tc9k2\" (UID: \"3d222f90-1ccf-476c-a0bb-0f784a6d9aae\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:40:58.781892 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.781816 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgwjj\"" Jul 02 15:40:58.789313 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.789283 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xd9rd\"" Jul 02 15:40:58.789456 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.789401 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbfgf" Jul 02 15:40:58.792332 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.792313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dnf8z" Jul 02 15:40:58.797426 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.797406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:40:58.821490 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.821458 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3d222f90-1ccf-476c-a0bb-0f784a6d9aae-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tc9k2\" (UID: \"3d222f90-1ccf-476c-a0bb-0f784a6d9aae\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:40:58.824490 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.824463 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3d222f90-1ccf-476c-a0bb-0f784a6d9aae-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-tc9k2\" (UID: \"3d222f90-1ccf-476c-a0bb-0f784a6d9aae\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:40:58.923593 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:58.923559 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:40:59.105013 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.104254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" event={"ID":"ebc93b26-7002-4e08-b02f-43e43306f770","Type":"ContainerStarted","Data":"1dd065f52819dc76d4a9bf947ee449c2cdbed8bccbf53f1c0939318f5dce9809"} Jul 02 15:40:59.106956 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.106925 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-s8m66" event={"ID":"6734c282-b9b3-4872-9753-afe860adfb32","Type":"ContainerStarted","Data":"bdc080dee920c5d921e95a82e8de30a37853d1ecd3dda8f5ee4a2910ce28c66d"} Jul 02 15:40:59.109912 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.109887 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dnf8z"] Jul 02 15:40:59.114836 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:59.114801 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e88ecf7_fef2_466d_a01a_e1664d827f3d.slice/crio-27ce4fd8b563c52a220c552293110ad96d3452f9c492d34ea19c8f0cf44fe1c8 WatchSource:0}: Error finding container 27ce4fd8b563c52a220c552293110ad96d3452f9c492d34ea19c8f0cf44fe1c8: Status 404 returned error can't find the container with id 27ce4fd8b563c52a220c552293110ad96d3452f9c492d34ea19c8f0cf44fe1c8 Jul 02 15:40:59.124605 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.124550 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-x7tch" podStartSLOduration=2.06517537 podStartE2EDuration="4.124527392s" totalImagesPullingTime="2.059352022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:59.123501877 +0000 UTC m=+66.761967597" watchObservedRunningTime="2026-07-02 15:40:59.124527392 +0000 UTC m=+66.762993112" Jul 02 15:40:59.137629 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.137601 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2"] Jul 02 15:40:59.141052 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.141001 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-s8m66" podStartSLOduration=1.266389631 podStartE2EDuration="4.140985932s" totalImagesPullingTime="2.874596301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:40:59.14008051 +0000 UTC m=+66.778546228" watchObservedRunningTime="2026-07-02 15:40:59.140985932 +0000 UTC m=+66.779451654" Jul 02 15:40:59.141190 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:59.141120 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d222f90_1ccf_476c_a0bb_0f784a6d9aae.slice/crio-b8df8f6e269ebc401dc95b61d2b7ec04926d1e3cb6a7fbe960727f5dec9e69f7 WatchSource:0}: Error finding container b8df8f6e269ebc401dc95b61d2b7ec04926d1e3cb6a7fbe960727f5dec9e69f7: Status 404 returned error can't find the container with id b8df8f6e269ebc401dc95b61d2b7ec04926d1e3cb6a7fbe960727f5dec9e69f7 Jul 02 15:40:59.358905 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.358869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbfgf"] Jul 02 15:40:59.361537 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.361501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ptmqv"] Jul 02 15:40:59.362297 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:59.362174 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7202620c_7799_4d63_b697_84be2251725c.slice/crio-1318212c2cc04557562b4c05cb2c4d2e37e57b1085c7c1656f5c0d8e8857067c WatchSource:0}: Error finding container 1318212c2cc04557562b4c05cb2c4d2e37e57b1085c7c1656f5c0d8e8857067c: Status 404 returned error can't find the container with id 1318212c2cc04557562b4c05cb2c4d2e37e57b1085c7c1656f5c0d8e8857067c Jul 02 15:40:59.364769 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:40:59.364731 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0388d88_6126_4ed0_b370_52602d20e634.slice/crio-e28248a769aa821efe500b3a345c97e60f75f5b7f4d7044648d9b389c4c181bd WatchSource:0}: Error finding container e28248a769aa821efe500b3a345c97e60f75f5b7f4d7044648d9b389c4c181bd: Status 404 returned error can't find the container with id e28248a769aa821efe500b3a345c97e60f75f5b7f4d7044648d9b389c4c181bd Jul 02 15:40:59.548586 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.548555 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8bvcb"] Jul 02 15:40:59.554323 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.554294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.557718 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.557697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s99hj\"" Jul 02 15:40:59.558426 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.558388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:40:59.558763 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.558742 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:40:59.571408 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.571368 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8bvcb"] Jul 02 15:40:59.631082 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.630978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.631082 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.631017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.631082 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.631036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-crio-socket\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.631082 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.631060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-data-volume\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.631403 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.631148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhtp\" (UniqueName: \"kubernetes.io/projected/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-api-access-rbhtp\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.732416 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.732468 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.732496 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-crio-socket\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.732540 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-data-volume\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.732584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhtp\" (UniqueName: \"kubernetes.io/projected/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-api-access-rbhtp\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:59.732997 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:59.733075 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:00.23305487 +0000 UTC m=+67.871520580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:59.733120 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:40:59.733156 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:00.233146162 +0000 UTC m=+67.871611873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : configmap "kube-rbac-proxy" not found Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.733344 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-crio-socket\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.733655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.733674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-data-volume\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:40:59.741162 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:40:59.741136 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhtp\" (UniqueName: \"kubernetes.io/projected/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-api-access-rbhtp\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:00.112929 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.112881 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ptmqv" event={"ID":"f0388d88-6126-4ed0-b370-52602d20e634","Type":"ContainerStarted","Data":"e28248a769aa821efe500b3a345c97e60f75f5b7f4d7044648d9b389c4c181bd"} Jul 02 15:41:00.114248 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.114199 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dnf8z" event={"ID":"3e88ecf7-fef2-466d-a01a-e1664d827f3d","Type":"ContainerStarted","Data":"27ce4fd8b563c52a220c552293110ad96d3452f9c492d34ea19c8f0cf44fe1c8"} Jul 02 15:41:00.115669 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.115641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbfgf" event={"ID":"7202620c-7799-4d63-b697-84be2251725c","Type":"ContainerStarted","Data":"1318212c2cc04557562b4c05cb2c4d2e37e57b1085c7c1656f5c0d8e8857067c"} Jul 02 15:41:00.117286 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.117208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" event={"ID":"3d222f90-1ccf-476c-a0bb-0f784a6d9aae","Type":"ContainerStarted","Data":"b8df8f6e269ebc401dc95b61d2b7ec04926d1e3cb6a7fbe960727f5dec9e69f7"} Jul 02 15:41:00.148072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.148032 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tdgp_cbd0fa6a-2d3b-491f-8e9b-398640396146/dns/0.log" Jul 02 15:41:00.236920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.236872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:00.237083 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.236963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:00.237083 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:00.236969 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:41:00.237196 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:00.237131 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:01.237108643 +0000 UTC m=+68.875574353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:41:00.237349 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:00.237038 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:41:00.237467 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:00.237388 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:01.237371491 +0000 UTC m=+68.875837202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : configmap "kube-rbac-proxy" not found Jul 02 15:41:00.320001 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:00.319965 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tdgp_cbd0fa6a-2d3b-491f-8e9b-398640396146/kube-rbac-proxy/0.log" Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:01.246834 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:01.246883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:01.246975 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:01.246991 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:01.247056 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:03.24703583 +0000 UTC m=+70.885501549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : configmap "kube-rbac-proxy" not found Jul 02 15:41:01.247218 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:01.247075 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:03.247066232 +0000 UTC m=+70.885531933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:41:01.318070 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:01.318041 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m92vz_bcd80b58-46d4-4b74-a10b-3c3005ff31a0/dns-node-resolver/0.log" Jul 02 15:41:02.122206 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.122172 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78bc9d9465-pkkq6_3fda9c87-a5f1-4784-b959-92110ad3ee60/registry/0.log" Jul 02 15:41:02.126391 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.126361 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbfgf" event={"ID":"7202620c-7799-4d63-b697-84be2251725c","Type":"ContainerStarted","Data":"cb05b10a61e26607b9cd00ce3025c8634268b47ad425623f6ce418c59f7d381c"} Jul 02 15:41:02.128189 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.128128 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" event={"ID":"3d222f90-1ccf-476c-a0bb-0f784a6d9aae","Type":"ContainerStarted","Data":"bd94f7e25dbe41d0bf43eaf9001e188b07b0adb2ce2d7883e490f4acd1c17e36"} Jul 02 15:41:02.128434 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.128415 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:41:02.134224 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.134199 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" Jul 02 15:41:02.164643 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.164582 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-tc9k2" podStartSLOduration=1.5237028540000002 podStartE2EDuration="4.164563162s" totalImagesPullingTime="2.640860308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:02.147050606 +0000 UTC m=+69.785516327" watchObservedRunningTime="2026-07-02 15:41:02.164563162 +0000 UTC m=+69.803028880" Jul 02 15:41:02.724391 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.724359 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrjr4_e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32/node-ca/0.log" Jul 02 15:41:02.754340 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.754302 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-8bhz5"] Jul 02 15:41:02.756587 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.756559 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.760504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.760410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 15:41:02.760504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.760429 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 15:41:02.760504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.760486 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:41:02.760504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.760431 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hm892\"" Jul 02 15:41:02.773988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.773927 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-8bhz5"] Jul 02 15:41:02.860091 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.860028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxffd\" (UniqueName: \"kubernetes.io/projected/a84eb7e8-7db0-445b-9e79-95591ceb2d40-kube-api-access-bxffd\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.860091 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.860081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84eb7e8-7db0-445b-9e79-95591ceb2d40-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.860336 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.860175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.860336 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.860224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.961605 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.961577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxffd\" (UniqueName: \"kubernetes.io/projected/a84eb7e8-7db0-445b-9e79-95591ceb2d40-kube-api-access-bxffd\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.961763 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.961610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84eb7e8-7db0-445b-9e79-95591ceb2d40-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.961763 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.961640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.961763 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.961668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.962334 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.962303 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84eb7e8-7db0-445b-9e79-95591ceb2d40-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.963911 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.963880 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.963911 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.963900 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a84eb7e8-7db0-445b-9e79-95591ceb2d40-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:02.970330 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:02.970300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxffd\" (UniqueName: \"kubernetes.io/projected/a84eb7e8-7db0-445b-9e79-95591ceb2d40-kube-api-access-bxffd\") pod \"prometheus-operator-7b7d896497-8bhz5\" (UID: \"a84eb7e8-7db0-445b-9e79-95591ceb2d40\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:03.066539 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:03.066457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" Jul 02 15:41:03.264552 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:03.264517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:03.264754 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:03.264565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:03.264754 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:03.264692 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:41:03.264754 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:03.264711 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:41:03.264923 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:03.264776 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:07.264754357 +0000 UTC m=+74.903220054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : configmap "kube-rbac-proxy" not found Jul 02 15:41:03.264923 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:03.264796 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:07.264785933 +0000 UTC m=+74.903251632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:41:03.317938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:03.317800 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7d7mt_ea79554b-e4d3-4a85-8eb0-fb2d271d359f/serve-healthcheck-canary/0.log" Jul 02 15:41:04.486707 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:04.486687 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-8bhz5"] Jul 02 15:41:04.490316 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:04.490283 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84eb7e8_7db0_445b_9e79_95591ceb2d40.slice/crio-ad377073765c7f695cd6df5843e211abf2c53d9ff90b33a1e21787ad02df9d03 WatchSource:0}: Error finding container ad377073765c7f695cd6df5843e211abf2c53d9ff90b33a1e21787ad02df9d03: Status 404 returned error can't find the container with id ad377073765c7f695cd6df5843e211abf2c53d9ff90b33a1e21787ad02df9d03 Jul 02 15:41:05.141162 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.141120 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" event={"ID":"a84eb7e8-7db0-445b-9e79-95591ceb2d40","Type":"ContainerStarted","Data":"ad377073765c7f695cd6df5843e211abf2c53d9ff90b33a1e21787ad02df9d03"} Jul 02 15:41:05.142571 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.142547 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ptmqv" event={"ID":"f0388d88-6126-4ed0-b370-52602d20e634","Type":"ContainerStarted","Data":"0e45d8cdcc9da928397a8c6a0ac6c24f51fdc9c29a905639432340fe511159f8"} Jul 02 15:41:05.142696 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.142669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:41:05.143933 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.143911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dnf8z" event={"ID":"3e88ecf7-fef2-466d-a01a-e1664d827f3d","Type":"ContainerStarted","Data":"05e44e4130456672a229edd855e0f03d5db3ca9985c509139372389c9e1c779f"} Jul 02 15:41:05.145503 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.145474 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbfgf" event={"ID":"7202620c-7799-4d63-b697-84be2251725c","Type":"ContainerStarted","Data":"4695e0a26f15e3fde4de109c1430070ffe3db1d037fe8d0fd09043903995a5ac"} Jul 02 15:41:05.158704 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.158665 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ptmqv" podStartSLOduration=67.179484937 podStartE2EDuration="1m12.158652777s" totalImagesPullingTime="4.97916784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:05.158212796 +0000 UTC m=+72.796678515" watchObservedRunningTime="2026-07-02 15:41:05.158652777 +0000 UTC m=+72.797118474" Jul 02 15:41:05.179490 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.179447 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rbfgf" podStartSLOduration=69.755146518 podStartE2EDuration="1m12.179429487s" totalImagesPullingTime="2.424282969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:05.179303222 +0000 UTC m=+72.817768976" watchObservedRunningTime="2026-07-02 15:41:05.179429487 +0000 UTC m=+72.817895206" Jul 02 15:41:05.198310 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.198268 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dnf8z" podStartSLOduration=66.966257858 podStartE2EDuration="1m12.198255448s" totalImagesPullingTime="5.23199759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:05.197525072 +0000 UTC m=+72.835990792" watchObservedRunningTime="2026-07-02 15:41:05.198255448 +0000 UTC m=+72.836721157" Jul 02 15:41:05.690280 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:05.690248 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:41:07.298994 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:07.298940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:07.298994 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:07.298999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:07.299487 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:07.299080 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:41:07.299487 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:07.299098 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:41:07.299487 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:07.299142 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:15.299122789 +0000 UTC m=+82.937588489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : configmap "kube-rbac-proxy" not found Jul 02 15:41:07.299487 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:07.299172 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:15.29915239 +0000 UTC m=+82.937618093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:41:08.158968 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:08.158927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" event={"ID":"a84eb7e8-7db0-445b-9e79-95591ceb2d40","Type":"ContainerStarted","Data":"feeebb75c5e010af1c2df24308d50afce497e6dc3691b5377d6a04802a7cdd13"} Jul 02 15:41:08.159114 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:08.158988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" event={"ID":"a84eb7e8-7db0-445b-9e79-95591ceb2d40","Type":"ContainerStarted","Data":"1ec34d60b64ea5614e9819d51bed55daa8e2ff2f845e5bf3df76ba4a83ee4a58"} Jul 02 15:41:08.178491 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:08.178439 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-8bhz5" podStartSLOduration=2.682047468 podStartE2EDuration="6.17842173s" totalImagesPullingTime="3.496374262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:08.178017897 +0000 UTC m=+75.816483616" watchObservedRunningTime="2026-07-02 15:41:08.17842173 +0000 UTC m=+75.816887449" Jul 02 15:41:10.177705 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.177674 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c"] Jul 02 15:41:10.179873 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.179853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.183474 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.183450 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 15:41:10.183605 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.183587 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5xkk8\"" Jul 02 15:41:10.183841 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.183826 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 15:41:10.197704 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.197685 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c"] Jul 02 15:41:10.228759 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.228730 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bdxnl"] Jul 02 15:41:10.230982 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.230962 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.234949 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.234926 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:41:10.235051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.234975 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x6z5v\"" Jul 02 15:41:10.235051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.234990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:41:10.235051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.234933 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:41:10.326895 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.326866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327048 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.326902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-sys\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327048 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.326923 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lk6\" (UniqueName: \"kubernetes.io/projected/572db80f-0a12-4493-bd44-e5c3b6cafd2c-kube-api-access-r7lk6\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.327048 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.327227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327052 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572db80f-0a12-4493-bd44-e5c3b6cafd2c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.327227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327100 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-root\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-wtmp\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-strfg\" (UniqueName: \"kubernetes.io/projected/a14704df-4a48-4c06-9897-0bf508210d95-kube-api-access-strfg\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-tls\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-textfile\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.327427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.327427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.327327 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-metrics-client-ca\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428354 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-tls\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428354 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428354 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-textfile\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428354 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-metrics-client-ca\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-sys\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lk6\" (UniqueName: \"kubernetes.io/projected/572db80f-0a12-4493-bd44-e5c3b6cafd2c-kube-api-access-r7lk6\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428523 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428534 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-sys\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572db80f-0a12-4493-bd44-e5c3b6cafd2c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-root\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-wtmp\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.428681 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-strfg\" (UniqueName: \"kubernetes.io/projected/a14704df-4a48-4c06-9897-0bf508210d95-kube-api-access-strfg\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428770 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-textfile\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428855 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-root\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428986 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-wtmp\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.428999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-accelerators-collector-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:10.429007 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 15:41:10.429145 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:10.429081 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls podName:572db80f-0a12-4493-bd44-e5c3b6cafd2c nodeName:}" failed. No retries permitted until 2026-07-02 15:41:10.929059696 +0000 UTC m=+78.567525628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-g5k8c" (UID: "572db80f-0a12-4493-bd44-e5c3b6cafd2c") : secret "openshift-state-metrics-tls" not found Jul 02 15:41:10.429481 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.429279 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572db80f-0a12-4493-bd44-e5c3b6cafd2c-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.429535 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.429483 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14704df-4a48-4c06-9897-0bf508210d95-metrics-client-ca\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.430873 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.430852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.430975 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.430875 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14704df-4a48-4c06-9897-0bf508210d95-node-exporter-tls\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.430975 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.430934 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.439804 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.439786 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-strfg\" (UniqueName: \"kubernetes.io/projected/a14704df-4a48-4c06-9897-0bf508210d95-kube-api-access-strfg\") pod \"node-exporter-bdxnl\" (UID: \"a14704df-4a48-4c06-9897-0bf508210d95\") " pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.439912 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.439891 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lk6\" (UniqueName: \"kubernetes.io/projected/572db80f-0a12-4493-bd44-e5c3b6cafd2c-kube-api-access-r7lk6\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.540276 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.540248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bdxnl" Jul 02 15:41:10.550505 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:10.550481 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14704df_4a48_4c06_9897_0bf508210d95.slice/crio-b86acf273ae7ed1461970c7b2d3e549e1d82bb11a8257b9cf156e7ecb0f93c48 WatchSource:0}: Error finding container b86acf273ae7ed1461970c7b2d3e549e1d82bb11a8257b9cf156e7ecb0f93c48: Status 404 returned error can't find the container with id b86acf273ae7ed1461970c7b2d3e549e1d82bb11a8257b9cf156e7ecb0f93c48 Jul 02 15:41:10.933342 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.933301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:10.935605 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:10.935574 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/572db80f-0a12-4493-bd44-e5c3b6cafd2c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-g5k8c\" (UID: \"572db80f-0a12-4493-bd44-e5c3b6cafd2c\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:11.088549 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.088499 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" Jul 02 15:41:11.172815 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.172777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdxnl" event={"ID":"a14704df-4a48-4c06-9897-0bf508210d95","Type":"ContainerStarted","Data":"b86acf273ae7ed1461970c7b2d3e549e1d82bb11a8257b9cf156e7ecb0f93c48"} Jul 02 15:41:11.253576 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.253543 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c"] Jul 02 15:41:11.256949 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:11.256923 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572db80f_0a12_4493_bd44_e5c3b6cafd2c.slice/crio-fe8d2a9e2d9373c7a937373cbc19f7c1bd698ee536213edfa1fb227f1ad2f71d WatchSource:0}: Error finding container fe8d2a9e2d9373c7a937373cbc19f7c1bd698ee536213edfa1fb227f1ad2f71d: Status 404 returned error can't find the container with id fe8d2a9e2d9373c7a937373cbc19f7c1bd698ee536213edfa1fb227f1ad2f71d Jul 02 15:41:11.260421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.260393 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:41:11.264288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.264263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.268846 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.268824 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 15:41:11.269314 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269297 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 15:41:11.269479 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269457 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269299 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269368 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269313 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269798 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269944 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ht2dx\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.269953 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 15:41:11.270519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.270088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 15:41:11.290468 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.290226 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:41:11.336605 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336764 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336764 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336764 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336764 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.336969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.336960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569v8\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.337182 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.337000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.337182 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.337063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.337182 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.337106 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438597 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569v8\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438765 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.438920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.439331 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.438955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.439331 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:11.439132 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle podName:6708397f-997d-4e7c-9228-0051a995d4ca nodeName:}" failed. No retries permitted until 2026-07-02 15:41:11.939110789 +0000 UTC m=+79.577576501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca") : configmap references non-existent config key: ca-bundle.crt Jul 02 15:41:11.439966 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.439707 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.440848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.440509 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.442874 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.442829 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.443301 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.443277 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.443606 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.443584 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.443875 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.443837 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.444135 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.444109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.444281 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.444201 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.444892 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.444851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.444973 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.444912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.446179 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.446156 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.450837 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.450805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-569v8\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.942858 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.942819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:11.943633 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:11.943614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:12.177531 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.177496 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:41:12.178376 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.178345 2582 generic.go:356] "Generic (PLEG): container finished" podID="a14704df-4a48-4c06-9897-0bf508210d95" containerID="abf98d89fe948ddc9e57ca25e1b9318bda7d0fc1609515fccc334fb2af53b501" exitCode=0 Jul 02 15:41:12.178499 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.178434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdxnl" event={"ID":"a14704df-4a48-4c06-9897-0bf508210d95","Type":"ContainerDied","Data":"abf98d89fe948ddc9e57ca25e1b9318bda7d0fc1609515fccc334fb2af53b501"} Jul 02 15:41:12.180529 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.180501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" event={"ID":"572db80f-0a12-4493-bd44-e5c3b6cafd2c","Type":"ContainerStarted","Data":"331cbb21876fdf08525e8165394b2c3cf5292d45f3bdb48bf5d8356b1ec8cd92"} Jul 02 15:41:12.180646 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.180579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" event={"ID":"572db80f-0a12-4493-bd44-e5c3b6cafd2c","Type":"ContainerStarted","Data":"e37d5e86536d2344002c9f1dfd2a1c50d2abe912f0011f241b3a16f6dc71eca0"} Jul 02 15:41:12.180646 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.180610 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" event={"ID":"572db80f-0a12-4493-bd44-e5c3b6cafd2c","Type":"ContainerStarted","Data":"fe8d2a9e2d9373c7a937373cbc19f7c1bd698ee536213edfa1fb227f1ad2f71d"} Jul 02 15:41:12.349786 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:12.349758 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:41:12.353750 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:12.353725 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6708397f_997d_4e7c_9228_0051a995d4ca.slice/crio-f56a0361ac90b255e08a7c4b56c0bbb26d539ebc4878b4dd7ffa112d0d63e39d WatchSource:0}: Error finding container f56a0361ac90b255e08a7c4b56c0bbb26d539ebc4878b4dd7ffa112d0d63e39d: Status 404 returned error can't find the container with id f56a0361ac90b255e08a7c4b56c0bbb26d539ebc4878b4dd7ffa112d0d63e39d Jul 02 15:41:13.191174 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:13.191059 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdxnl" event={"ID":"a14704df-4a48-4c06-9897-0bf508210d95","Type":"ContainerStarted","Data":"563c3b50eaadf3f0e2563272d8d0fac6583783129471b51bb7f9aa602dc16b46"} Jul 02 15:41:13.191365 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:13.191230 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bdxnl" event={"ID":"a14704df-4a48-4c06-9897-0bf508210d95","Type":"ContainerStarted","Data":"3ea3f9dfb05f7c75e0c307605ccb7c0652f1e27cfd10124a3874c0d655afe5d7"} Jul 02 15:41:13.193964 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:13.193936 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"f56a0361ac90b255e08a7c4b56c0bbb26d539ebc4878b4dd7ffa112d0d63e39d"} Jul 02 15:41:13.211871 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:13.211820 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bdxnl" podStartSLOduration=2.177858899 podStartE2EDuration="3.211800676s" totalImagesPullingTime="966.551884ms" totalInitContainerRuntime="67.389893ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:13.211129239 +0000 UTC m=+80.849594971" watchObservedRunningTime="2026-07-02 15:41:13.211800676 +0000 UTC m=+80.850266395" Jul 02 15:41:14.199072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.198953 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15" exitCode=0 Jul 02 15:41:14.199072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.199041 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15"} Jul 02 15:41:14.201207 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.201187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" event={"ID":"572db80f-0a12-4493-bd44-e5c3b6cafd2c","Type":"ContainerStarted","Data":"5aee97c85cddd15aab42c48b552404b0ec2cf65f96946552a942c0bf0641ba6d"} Jul 02 15:41:14.287610 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.287554 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-g5k8c" podStartSLOduration=2.1714820870000002 podStartE2EDuration="4.287539047s" totalImagesPullingTime="2.11605696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:14.287095144 +0000 UTC m=+81.925560857" watchObservedRunningTime="2026-07-02 15:41:14.287539047 +0000 UTC m=+81.926004766" Jul 02 15:41:14.577110 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.577034 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7db9f9ff9d-rjpws"] Jul 02 15:41:14.579245 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.579216 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.581810 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.581764 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 15:41:14.581810 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.581785 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 15:41:14.581935 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.581772 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cqkg9\"" Jul 02 15:41:14.581935 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.581866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 15:41:14.582219 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.582202 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:41:14.582314 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.582285 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7dlt4tvgrh39p\"" Jul 02 15:41:14.590779 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.590759 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7db9f9ff9d-rjpws"] Jul 02 15:41:14.668865 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.668820 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-client-certs\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.668929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-tls\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.668957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-audit-log\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.669008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.669034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgdl\" (UniqueName: \"kubernetes.io/projected/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-kube-api-access-njgdl\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669169 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.669066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-metrics-server-audit-profiles\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.669169 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.669085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-client-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.769995 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.769968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgdl\" (UniqueName: \"kubernetes.io/projected/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-kube-api-access-njgdl\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-metrics-server-audit-profiles\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-client-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-client-certs\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770167 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-tls\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770424 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-audit-log\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770701 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770651 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-audit-log\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.770882 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.770851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.771112 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.771092 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-metrics-server-audit-profiles\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.772856 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.772830 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-client-ca-bundle\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.772938 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.772866 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-tls\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.773046 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.773025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-secret-metrics-server-client-certs\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.778111 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.778090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgdl\" (UniqueName: \"kubernetes.io/projected/899ce431-c4d5-4b2c-9bcb-fbaa753a06cc-kube-api-access-njgdl\") pod \"metrics-server-7db9f9ff9d-rjpws\" (UID: \"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc\") " pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.888687 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.888657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:14.922829 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.922797 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7"] Jul 02 15:41:14.924936 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.924919 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:14.927371 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.927347 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jgd5p\"" Jul 02 15:41:14.927617 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.927601 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 15:41:14.948782 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:14.948635 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7"] Jul 02 15:41:15.022781 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.022739 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7db9f9ff9d-rjpws"] Jul 02 15:41:15.025496 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:15.025470 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899ce431_c4d5_4b2c_9bcb_fbaa753a06cc.slice/crio-da82d9902d9fc08973b17140d17d3afc23379cc620a0fa1423f4055991ed31db WatchSource:0}: Error finding container da82d9902d9fc08973b17140d17d3afc23379cc620a0fa1423f4055991ed31db: Status 404 returned error can't find the container with id da82d9902d9fc08973b17140d17d3afc23379cc620a0fa1423f4055991ed31db Jul 02 15:41:15.072355 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.072327 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgx9h\" (UniqueName: \"kubernetes.io/projected/fc167e75-fc5c-4cf8-ad99-760f19c02e02-kube-api-access-xgx9h\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.072528 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.072446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.173388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.173305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgx9h\" (UniqueName: \"kubernetes.io/projected/fc167e75-fc5c-4cf8-ad99-760f19c02e02-kube-api-access-xgx9h\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.173388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.173367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.173545 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:15.173466 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 15:41:15.173545 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:15.173520 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert podName:fc167e75-fc5c-4cf8-ad99-760f19c02e02 nodeName:}" failed. No retries permitted until 2026-07-02 15:41:15.673504157 +0000 UTC m=+83.311969854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-2z2s7" (UID: "fc167e75-fc5c-4cf8-ad99-760f19c02e02") : secret "monitoring-plugin-cert" not found Jul 02 15:41:15.184293 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.184267 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgx9h\" (UniqueName: \"kubernetes.io/projected/fc167e75-fc5c-4cf8-ad99-760f19c02e02-kube-api-access-xgx9h\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.210168 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.210129 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" event={"ID":"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc","Type":"ContainerStarted","Data":"da82d9902d9fc08973b17140d17d3afc23379cc620a0fa1423f4055991ed31db"} Jul 02 15:41:15.375711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.375668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:15.375711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.375712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:15.375956 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:15.375768 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:41:15.375956 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:41:15.375856 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls podName:c62056ae-e037-40ce-b3f6-e9960d7b3b9e nodeName:}" failed. No retries permitted until 2026-07-02 15:41:31.375833723 +0000 UTC m=+99.014299442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8bvcb" (UID: "c62056ae-e037-40ce-b3f6-e9960d7b3b9e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:41:15.376334 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.376317 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:15.677709 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.677675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.680370 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.680340 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc167e75-fc5c-4cf8-ad99-760f19c02e02-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-2z2s7\" (UID: \"fc167e75-fc5c-4cf8-ad99-760f19c02e02\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.836289 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.836258 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:15.973145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:15.973071 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7"] Jul 02 15:41:15.975993 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:15.975968 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc167e75_fc5c_4cf8_ad99_760f19c02e02.slice/crio-4774f6d9e726cc4dd8a684acc24ea959c7cda1a0cbd3625024cdc87dcf17113d WatchSource:0}: Error finding container 4774f6d9e726cc4dd8a684acc24ea959c7cda1a0cbd3625024cdc87dcf17113d: Status 404 returned error can't find the container with id 4774f6d9e726cc4dd8a684acc24ea959c7cda1a0cbd3625024cdc87dcf17113d Jul 02 15:41:16.215001 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.214965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" event={"ID":"fc167e75-fc5c-4cf8-ad99-760f19c02e02","Type":"ContainerStarted","Data":"4774f6d9e726cc4dd8a684acc24ea959c7cda1a0cbd3625024cdc87dcf17113d"} Jul 02 15:41:16.354474 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.354376 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:41:16.359139 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.359112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.361474 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.361450 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:41:16.362454 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.362428 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:41:16.364491 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.364198 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:41:16.364491 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.364459 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:41:16.364806 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.364669 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:41:16.364923 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.364877 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z5npn\"" Jul 02 15:41:16.365130 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.365104 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:41:16.366577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366120 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:41:16.366577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366181 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:41:16.366577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366126 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:41:16.366577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366344 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:41:16.366577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:41:16.366909 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-vcrv912e80a\"" Jul 02 15:41:16.366909 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366701 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:41:16.367006 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.366941 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:41:16.370490 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.370445 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:41:16.377719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.377610 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:41:16.485945 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.485903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwp4\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.485957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.485985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486117 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486089 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486182 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486392 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486616 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.486692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.486665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587227 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwp4\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587496 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587523 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.587719 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588094 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588094 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588094 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588094 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.587825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588814 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.588693 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.588814 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.588798 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.589550 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.589811 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.589977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.591546 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.591866 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.592255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.592229 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.593168 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.593146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.593935 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.593908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.593914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.593945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594158 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594048 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594158 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594293 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594202 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594293 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594275 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594432 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.594863 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.594839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.596419 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.596396 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.596767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.596743 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwp4\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4\") pod \"prometheus-k8s-0\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:16.674384 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:16.674337 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:17.274926 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:17.274889 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:41:17.279402 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:17.279366 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1deb932e_8177_427d_8081_e193aea1e949.slice/crio-d66a3af190b202ea87cbaa86c0a251864caf51c4b22474331dfe95336311d4da WatchSource:0}: Error finding container d66a3af190b202ea87cbaa86c0a251864caf51c4b22474331dfe95336311d4da: Status 404 returned error can't find the container with id d66a3af190b202ea87cbaa86c0a251864caf51c4b22474331dfe95336311d4da Jul 02 15:41:18.235917 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.235695 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8"} Jul 02 15:41:18.235917 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.235784 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17"} Jul 02 15:41:18.235917 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.235829 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a"} Jul 02 15:41:18.235917 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.235869 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e"} Jul 02 15:41:18.237399 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.237375 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" event={"ID":"899ce431-c4d5-4b2c-9bcb-fbaa753a06cc","Type":"ContainerStarted","Data":"55a77054d6b2361a754c96172c7fbcd3ab16612e56a826f73c2f0a9fd28afb09"} Jul 02 15:41:18.239508 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.239037 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" event={"ID":"fc167e75-fc5c-4cf8-ad99-760f19c02e02","Type":"ContainerStarted","Data":"92616f6f46c25e2b5576effb76a3515bf82ce480fdccfdf43bb5bd1e270d52c1"} Jul 02 15:41:18.239968 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.239643 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:18.241027 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.241003 2582 patch_prober.go:28] interesting pod/monitoring-plugin-cd8656b8-2z2s7 container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.17:9443/health\": dial tcp 10.133.0.17:9443: connect: connection refused" start-of-body= Jul 02 15:41:18.241114 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.241050 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" podUID="fc167e75-fc5c-4cf8-ad99-760f19c02e02" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.133.0.17:9443/health\": dial tcp 10.133.0.17:9443: connect: connection refused" Jul 02 15:41:18.241799 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.241684 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" exitCode=0 Jul 02 15:41:18.241799 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.241735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} Jul 02 15:41:18.241799 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.241794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"d66a3af190b202ea87cbaa86c0a251864caf51c4b22474331dfe95336311d4da"} Jul 02 15:41:18.255251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.255187 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" podStartSLOduration=1.137566964 podStartE2EDuration="4.255172489s" totalImagesPullingTime="3.117605525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:18.253670347 +0000 UTC m=+85.892136090" watchObservedRunningTime="2026-07-02 15:41:18.255172489 +0000 UTC m=+85.893638273" Jul 02 15:41:18.268940 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:18.268887 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" podStartSLOduration=2.10226095 podStartE2EDuration="4.26885897s" totalImagesPullingTime="2.16659802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:18.267819699 +0000 UTC m=+85.906285422" watchObservedRunningTime="2026-07-02 15:41:18.26885897 +0000 UTC m=+85.907324690" Jul 02 15:41:19.249346 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:19.249247 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1"} Jul 02 15:41:19.249780 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:19.249370 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerStarted","Data":"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07"} Jul 02 15:41:19.254116 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:19.254088 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-2z2s7" Jul 02 15:41:19.279427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:19.279362 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.352058928 podStartE2EDuration="8.2793402s" totalImagesPullingTime="4.906550248s" totalInitContainerRuntime="20.731024ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:19.277197191 +0000 UTC m=+86.915662927" watchObservedRunningTime="2026-07-02 15:41:19.2793402 +0000 UTC m=+86.917805919" Jul 02 15:41:20.703773 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:20.703728 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" podUID="3fda9c87-a5f1-4784-b959-92110ad3ee60" containerName="registry" containerID="cri-o://c80a077025b0fec4c844cc771aa6bb092a985bca6094acdec69e43cdb2489c4f" gracePeriod=30 Jul 02 15:41:21.259975 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.259862 2582 generic.go:356] "Generic (PLEG): container finished" podID="3fda9c87-a5f1-4784-b959-92110ad3ee60" containerID="c80a077025b0fec4c844cc771aa6bb092a985bca6094acdec69e43cdb2489c4f" exitCode=0 Jul 02 15:41:21.259975 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.259903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" event={"ID":"3fda9c87-a5f1-4784-b959-92110ad3ee60","Type":"ContainerDied","Data":"c80a077025b0fec4c844cc771aa6bb092a985bca6094acdec69e43cdb2489c4f"} Jul 02 15:41:21.363811 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.363557 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:41:21.543700 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543576 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.543700 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543637 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbd9c\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.543700 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543663 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.543700 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543701 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.544033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543726 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.544033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543754 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.544033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543783 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.544033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.543822 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted\") pod \"3fda9c87-a5f1-4784-b959-92110ad3ee60\" (UID: \"3fda9c87-a5f1-4784-b959-92110ad3ee60\") " Jul 02 15:41:21.545767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.545119 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:41:21.545767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.545502 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:41:21.549801 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.549746 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:41:21.550065 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.550036 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:41:21.550172 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.550148 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:41:21.550298 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.550282 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c" (OuterVolumeSpecName: "kube-api-access-nbd9c") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "kube-api-access-nbd9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:41:21.551222 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.551186 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:41:21.556425 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.556396 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3fda9c87-a5f1-4784-b959-92110ad3ee60" (UID: "3fda9c87-a5f1-4784-b959-92110ad3ee60"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:41:21.644688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644645 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-image-registry-private-configuration\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644683 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbd9c\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-kube-api-access-nbd9c\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644695 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644704 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fda9c87-a5f1-4784-b959-92110ad3ee60-bound-sa-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644713 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fda9c87-a5f1-4784-b959-92110ad3ee60-installation-pull-secrets\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644722 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-registry-certificates\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644730 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fda9c87-a5f1-4784-b959-92110ad3ee60-trusted-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:21.644920 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:21.644738 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fda9c87-a5f1-4784-b959-92110ad3ee60-ca-trust-extracted\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:41:22.265274 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.265220 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" Jul 02 15:41:22.265274 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.265251 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bc9d9465-pkkq6" event={"ID":"3fda9c87-a5f1-4784-b959-92110ad3ee60","Type":"ContainerDied","Data":"86e2a5baa641b1f7632e5bc0a0cf5706f40983cc1f53ba5041449652d9fd3a32"} Jul 02 15:41:22.265836 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.265327 2582 scope.go:117] "RemoveContainer" containerID="c80a077025b0fec4c844cc771aa6bb092a985bca6094acdec69e43cdb2489c4f" Jul 02 15:41:22.267739 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.267711 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} Jul 02 15:41:22.267849 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.267792 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} Jul 02 15:41:22.286253 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.286212 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:41:22.290687 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.290657 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78bc9d9465-pkkq6"] Jul 02 15:41:22.771550 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:22.771514 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fda9c87-a5f1-4784-b959-92110ad3ee60" path="/var/lib/kubelet/pods/3fda9c87-a5f1-4784-b959-92110ad3ee60/volumes" Jul 02 15:41:25.286420 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:25.286387 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} Jul 02 15:41:25.286731 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:25.286453 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} Jul 02 15:41:26.293910 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:26.293866 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} Jul 02 15:41:26.294312 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:26.293991 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerStarted","Data":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} Jul 02 15:41:26.332798 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:26.332741 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.626284852 podStartE2EDuration="10.332720324s" totalImagesPullingTime="6.68223238s" totalInitContainerRuntime="24.203092ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:41:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:26.329694813 +0000 UTC m=+93.968160536" watchObservedRunningTime="2026-07-02 15:41:26.332720324 +0000 UTC m=+93.971186043" Jul 02 15:41:26.674543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:26.674499 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:41:31.421958 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:31.421909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:31.424304 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:31.424282 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c62056ae-e037-40ce-b3f6-e9960d7b3b9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8bvcb\" (UID: \"c62056ae-e037-40ce-b3f6-e9960d7b3b9e\") " pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:31.669057 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:31.669025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8bvcb" Jul 02 15:41:31.802011 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:31.801978 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8bvcb"] Jul 02 15:41:31.804888 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:41:31.804861 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62056ae_e037_40ce_b3f6_e9960d7b3b9e.slice/crio-100172ed43f5dcd538950e73ea5b9a5b7b4687189d8fb441fbf77278d0c03400 WatchSource:0}: Error finding container 100172ed43f5dcd538950e73ea5b9a5b7b4687189d8fb441fbf77278d0c03400: Status 404 returned error can't find the container with id 100172ed43f5dcd538950e73ea5b9a5b7b4687189d8fb441fbf77278d0c03400 Jul 02 15:41:32.319340 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:32.319302 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bvcb" event={"ID":"c62056ae-e037-40ce-b3f6-e9960d7b3b9e","Type":"ContainerStarted","Data":"100172ed43f5dcd538950e73ea5b9a5b7b4687189d8fb441fbf77278d0c03400"} Jul 02 15:41:34.889146 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:34.889113 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:34.889509 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:34.889179 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:36.152900 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:36.152872 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ptmqv" Jul 02 15:41:36.337549 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:36.337512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bvcb" event={"ID":"c62056ae-e037-40ce-b3f6-e9960d7b3b9e","Type":"ContainerStarted","Data":"17bd6b53fd6f5a2c7a26a6140ea83c2993abb3ee20bb80410ca9af3940da6d3c"} Jul 02 15:41:38.348249 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:38.348191 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bvcb" event={"ID":"c62056ae-e037-40ce-b3f6-e9960d7b3b9e","Type":"ContainerStarted","Data":"50c4398b478b07c9c2fdeaed3207f2d8dc8eb1364900722e06ff802a505cfd81"} Jul 02 15:41:40.357880 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:40.357846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8bvcb" event={"ID":"c62056ae-e037-40ce-b3f6-e9960d7b3b9e","Type":"ContainerStarted","Data":"36d92ed4b03c9a24fa85d509648a8666377a0a2fc512eb8ebbc41aa5f3d4c849"} Jul 02 15:41:40.378785 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:40.378705 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8bvcb" podStartSLOduration=33.231091437 podStartE2EDuration="41.378690583s" totalImagesPullingTime="8.147599146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:40:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:40.376955699 +0000 UTC m=+108.015421417" watchObservedRunningTime="2026-07-02 15:41:40.378690583 +0000 UTC m=+108.017156302" Jul 02 15:41:54.894539 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:54.894505 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:41:54.898331 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:41:54.898308 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7db9f9ff9d-rjpws" Jul 02 15:42:16.674652 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:16.674611 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:16.693623 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:16.693599 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:17.514201 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:17.514175 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:30.481764 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.481731 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482022 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="alertmanager" containerID="cri-o://f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" gracePeriod=120 Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482093 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-metric" containerID="cri-o://0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" gracePeriod=120 Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482105 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-web" containerID="cri-o://3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" gracePeriod=120 Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482125 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy" containerID="cri-o://cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" gracePeriod=120 Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482155 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="prom-label-proxy" containerID="cri-o://0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" gracePeriod=120 Jul 02 15:42:30.482324 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:30.482193 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="config-reloader" containerID="cri-o://526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" gracePeriod=120 Jul 02 15:42:31.554711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554676 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" exitCode=0 Jul 02 15:42:31.554711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554705 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" exitCode=0 Jul 02 15:42:31.554711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554713 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" exitCode=0 Jul 02 15:42:31.554711 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554719 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" exitCode=0 Jul 02 15:42:31.555261 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554748 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1"} Jul 02 15:42:31.555261 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554837 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8"} Jul 02 15:42:31.555261 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554883 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a"} Jul 02 15:42:31.555261 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.554921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e"} Jul 02 15:42:31.728647 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.728617 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:31.841222 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841137 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841222 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841188 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841380 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841427 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841415 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841497 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841459 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841538 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841497 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841538 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841523 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841638 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841609 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841692 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841656 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841761 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841743 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841824 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841793 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-569v8\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841869 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841821 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841869 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841857 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config\") pod \"6708397f-997d-4e7c-9228-0051a995d4ca\" (UID: \"6708397f-997d-4e7c-9228-0051a995d4ca\") " Jul 02 15:42:31.841969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.841878 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:31.842150 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.842128 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-metrics-client-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.843172 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.843123 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:42:31.843317 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.843189 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:31.844087 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.844050 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.844388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.844362 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out" (OuterVolumeSpecName: "config-out") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:42:31.844388 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.844383 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.844547 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.844423 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume" (OuterVolumeSpecName: "config-volume") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.844904 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.844868 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.845187 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.845162 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.845881 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.845853 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:42:31.846192 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.846170 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8" (OuterVolumeSpecName: "kube-api-access-569v8") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "kube-api-access-569v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:42:31.849092 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.849068 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.854852 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.854829 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config" (OuterVolumeSpecName: "web-config") pod "6708397f-997d-4e7c-9228-0051a995d4ca" (UID: "6708397f-997d-4e7c-9228-0051a995d4ca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:31.943451 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943405 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-config-out\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943451 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943448 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-569v8\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-kube-api-access-569v8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943451 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943459 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-main-db\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943451 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943468 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-web-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943477 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943487 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943496 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-main-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943506 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-cluster-tls-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943515 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-config-volume\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943524 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6708397f-997d-4e7c-9228-0051a995d4ca-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943532 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6708397f-997d-4e7c-9228-0051a995d4ca-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:31.943714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:31.943541 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6708397f-997d-4e7c-9228-0051a995d4ca-tls-assets\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:32.561414 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561376 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" exitCode=0 Jul 02 15:42:32.561414 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561404 2582 generic.go:356] "Generic (PLEG): container finished" podID="6708397f-997d-4e7c-9228-0051a995d4ca" containerID="3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" exitCode=0 Jul 02 15:42:32.561850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561427 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07"} Jul 02 15:42:32.561850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561549 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17"} Jul 02 15:42:32.561850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561563 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.561850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6708397f-997d-4e7c-9228-0051a995d4ca","Type":"ContainerDied","Data":"f56a0361ac90b255e08a7c4b56c0bbb26d539ebc4878b4dd7ffa112d0d63e39d"} Jul 02 15:42:32.561850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.561623 2582 scope.go:117] "RemoveContainer" containerID="0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" Jul 02 15:42:32.573932 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.573912 2582 scope.go:117] "RemoveContainer" containerID="0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" Jul 02 15:42:32.580834 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.580818 2582 scope.go:117] "RemoveContainer" containerID="cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" Jul 02 15:42:32.588504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.588475 2582 scope.go:117] "RemoveContainer" containerID="3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" Jul 02 15:42:32.590637 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.590609 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:32.596402 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.596368 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:32.598891 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.598740 2582 scope.go:117] "RemoveContainer" containerID="526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" Jul 02 15:42:32.606225 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.606209 2582 scope.go:117] "RemoveContainer" containerID="f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" Jul 02 15:42:32.613165 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.613143 2582 scope.go:117] "RemoveContainer" containerID="96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15" Jul 02 15:42:32.620228 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.620177 2582 scope.go:117] "RemoveContainer" containerID="0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" Jul 02 15:42:32.620704 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.620682 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1\": container with ID starting with 0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1 not found: ID does not exist" containerID="0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" Jul 02 15:42:32.620754 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.620716 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1"} err="failed to get container status \"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1\": rpc error: code = NotFound desc = could not find container \"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1\": container with ID starting with 0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1 not found: ID does not exist" Jul 02 15:42:32.620754 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.620752 2582 scope.go:117] "RemoveContainer" containerID="0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" Jul 02 15:42:32.620981 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.620960 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07\": container with ID starting with 0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07 not found: ID does not exist" containerID="0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" Jul 02 15:42:32.621033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.620987 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07"} err="failed to get container status \"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07\": rpc error: code = NotFound desc = could not find container \"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07\": container with ID starting with 0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07 not found: ID does not exist" Jul 02 15:42:32.621033 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621009 2582 scope.go:117] "RemoveContainer" containerID="cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" Jul 02 15:42:32.621272 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.621222 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8\": container with ID starting with cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8 not found: ID does not exist" containerID="cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" Jul 02 15:42:32.621272 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621259 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8"} err="failed to get container status \"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8\": rpc error: code = NotFound desc = could not find container \"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8\": container with ID starting with cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8 not found: ID does not exist" Jul 02 15:42:32.621272 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621271 2582 scope.go:117] "RemoveContainer" containerID="3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" Jul 02 15:42:32.621496 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.621480 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17\": container with ID starting with 3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17 not found: ID does not exist" containerID="3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" Jul 02 15:42:32.621532 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621500 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17"} err="failed to get container status \"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17\": rpc error: code = NotFound desc = could not find container \"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17\": container with ID starting with 3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17 not found: ID does not exist" Jul 02 15:42:32.621532 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621514 2582 scope.go:117] "RemoveContainer" containerID="526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" Jul 02 15:42:32.621752 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.621737 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a\": container with ID starting with 526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a not found: ID does not exist" containerID="526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" Jul 02 15:42:32.621786 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621757 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a"} err="failed to get container status \"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a\": rpc error: code = NotFound desc = could not find container \"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a\": container with ID starting with 526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a not found: ID does not exist" Jul 02 15:42:32.621786 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621770 2582 scope.go:117] "RemoveContainer" containerID="f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" Jul 02 15:42:32.621966 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.621949 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e\": container with ID starting with f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e not found: ID does not exist" containerID="f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" Jul 02 15:42:32.622039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621975 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e"} err="failed to get container status \"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e\": rpc error: code = NotFound desc = could not find container \"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e\": container with ID starting with f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e not found: ID does not exist" Jul 02 15:42:32.622039 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.621998 2582 scope.go:117] "RemoveContainer" containerID="96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15" Jul 02 15:42:32.622250 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:32.622221 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15\": container with ID starting with 96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15 not found: ID does not exist" containerID="96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15" Jul 02 15:42:32.622286 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622254 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15"} err="failed to get container status \"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15\": rpc error: code = NotFound desc = could not find container \"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15\": container with ID starting with 96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15 not found: ID does not exist" Jul 02 15:42:32.622286 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622268 2582 scope.go:117] "RemoveContainer" containerID="0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1" Jul 02 15:42:32.622475 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622460 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1"} err="failed to get container status \"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1\": rpc error: code = NotFound desc = could not find container \"0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1\": container with ID starting with 0fb63dd7f25527114da8d2f8876e6a30722c0d7ae68caeab8b7c6a8c58a0c7a1 not found: ID does not exist" Jul 02 15:42:32.622519 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622476 2582 scope.go:117] "RemoveContainer" containerID="0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07" Jul 02 15:42:32.622698 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622680 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07"} err="failed to get container status \"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07\": rpc error: code = NotFound desc = could not find container \"0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07\": container with ID starting with 0891d5381ac9242972687a6d0f3b00cba7c470310691c15cf70802f74eb9ad07 not found: ID does not exist" Jul 02 15:42:32.622759 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622700 2582 scope.go:117] "RemoveContainer" containerID="cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8" Jul 02 15:42:32.622922 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622903 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8"} err="failed to get container status \"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8\": rpc error: code = NotFound desc = could not find container \"cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8\": container with ID starting with cecccdf9c20beb1bf5496b7f3d831f83d8c5744eccadfab9cefee2f059242cf8 not found: ID does not exist" Jul 02 15:42:32.622972 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.622924 2582 scope.go:117] "RemoveContainer" containerID="3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17" Jul 02 15:42:32.623138 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623121 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17"} err="failed to get container status \"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17\": rpc error: code = NotFound desc = could not find container \"3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17\": container with ID starting with 3e6bd92e7f6ee86f6a1c30350fbd5333ac4a1549859122323a86d5110911aa17 not found: ID does not exist" Jul 02 15:42:32.623205 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623140 2582 scope.go:117] "RemoveContainer" containerID="526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a" Jul 02 15:42:32.623395 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623377 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a"} err="failed to get container status \"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a\": rpc error: code = NotFound desc = could not find container \"526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a\": container with ID starting with 526ca7eea666f7e3bbe2a4134ee1131aca9d07b0e94b96cdfffc209b349c294a not found: ID does not exist" Jul 02 15:42:32.623440 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623396 2582 scope.go:117] "RemoveContainer" containerID="f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e" Jul 02 15:42:32.623639 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623623 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e"} err="failed to get container status \"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e\": rpc error: code = NotFound desc = could not find container \"f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e\": container with ID starting with f83e99441ca9dbf9642212485b9164266ba19e2ada9a81774a049e1fc7e0d26e not found: ID does not exist" Jul 02 15:42:32.623708 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623641 2582 scope.go:117] "RemoveContainer" containerID="96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15" Jul 02 15:42:32.623862 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.623843 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15"} err="failed to get container status \"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15\": rpc error: code = NotFound desc = could not find container \"96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15\": container with ID starting with 96d16c6d02280da0775675b854ff98585ecbc063ef3b63d7bdf26023a6423c15 not found: ID does not exist" Jul 02 15:42:32.632058 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632038 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:32.632339 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632327 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-web" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632341 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-web" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632350 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fda9c87-a5f1-4784-b959-92110ad3ee60" containerName="registry" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632355 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fda9c87-a5f1-4784-b959-92110ad3ee60" containerName="registry" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632364 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="prom-label-proxy" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632369 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="prom-label-proxy" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632379 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-metric" Jul 02 15:42:32.632385 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632384 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-metric" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632395 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="init-config-reloader" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632400 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="init-config-reloader" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632406 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="config-reloader" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632411 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="config-reloader" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632423 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632428 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632437 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="alertmanager" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632442 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="alertmanager" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632484 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632492 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-metric" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632497 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="config-reloader" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632503 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="prom-label-proxy" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632508 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fda9c87-a5f1-4784-b959-92110ad3ee60" containerName="registry" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632514 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="kube-rbac-proxy-web" Jul 02 15:42:32.632585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.632520 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" containerName="alertmanager" Jul 02 15:42:32.636838 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.636812 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.639834 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.639812 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 15:42:32.639834 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.639831 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 15:42:32.639973 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.639912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 15:42:32.640107 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.640091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ht2dx\"" Jul 02 15:42:32.640165 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.640151 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 15:42:32.640286 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.640267 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 15:42:32.640823 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.640807 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 15:42:32.640892 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.640810 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 15:42:32.641289 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.641275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 15:42:32.646451 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.646435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 15:42:32.655714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.655692 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:32.749588 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749588 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-config-out\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wk4n\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-kube-api-access-6wk4n\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.749913 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.750216 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749943 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-web-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.750216 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.749991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.750216 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.750021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.771402 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.771375 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6708397f-997d-4e7c-9228-0051a995d4ca" path="/var/lib/kubelet/pods/6708397f-997d-4e7c-9228-0051a995d4ca/volumes" Jul 02 15:42:32.851415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851415 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-config-out\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851655 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851743 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851800 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851859 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wk4n\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-kube-api-access-6wk4n\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851909 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.851962 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.852012 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.851987 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.852079 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.852038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.852079 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.852062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-web-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.852201 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.852176 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.852403 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.852382 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.853340 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.853288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/276f9a7c-8de5-4535-8127-2082d9d04e14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.854634 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.854607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-config-volume\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.854737 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.854633 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.854737 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.854663 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.855065 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.855047 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.855504 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.855481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/276f9a7c-8de5-4535-8127-2082d9d04e14-config-out\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.855648 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.855629 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.855909 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.855887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-web-config\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.856003 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.855961 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.856878 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.856855 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/276f9a7c-8de5-4535-8127-2082d9d04e14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.861099 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.861071 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wk4n\" (UniqueName: \"kubernetes.io/projected/276f9a7c-8de5-4535-8127-2082d9d04e14-kube-api-access-6wk4n\") pod \"alertmanager-main-0\" (UID: \"276f9a7c-8de5-4535-8127-2082d9d04e14\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:32.946661 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:32.946619 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 15:42:33.096092 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:33.096060 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 15:42:33.099897 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:42:33.099871 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276f9a7c_8de5_4535_8127_2082d9d04e14.slice/crio-958b7ce7b2f4eaeba2abaaaf82b68f965f866b3cc59e33bf60272e756d090307 WatchSource:0}: Error finding container 958b7ce7b2f4eaeba2abaaaf82b68f965f866b3cc59e33bf60272e756d090307: Status 404 returned error can't find the container with id 958b7ce7b2f4eaeba2abaaaf82b68f965f866b3cc59e33bf60272e756d090307 Jul 02 15:42:33.568022 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:33.567985 2582 generic.go:356] "Generic (PLEG): container finished" podID="276f9a7c-8de5-4535-8127-2082d9d04e14" containerID="54a062116fc3af1ee420abc3838af04a6cf6c8a1ad8508adb00e58cc9f26ec9f" exitCode=0 Jul 02 15:42:33.568411 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:33.568075 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerDied","Data":"54a062116fc3af1ee420abc3838af04a6cf6c8a1ad8508adb00e58cc9f26ec9f"} Jul 02 15:42:33.568411 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:33.568148 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"958b7ce7b2f4eaeba2abaaaf82b68f965f866b3cc59e33bf60272e756d090307"} Jul 02 15:42:34.468600 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.468561 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67d5f69869-5kg6z"] Jul 02 15:42:34.471201 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.471181 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.474195 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 15:42:34.474195 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474159 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 15:42:34.474399 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474269 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qlfj9\"" Jul 02 15:42:34.474399 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474274 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 15:42:34.474399 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 15:42:34.474552 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.474520 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 15:42:34.479696 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.479672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 15:42:34.486693 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.486667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d5f69869-5kg6z"] Jul 02 15:42:34.565473 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565473 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-serving-certs-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565671 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565671 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565671 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565776 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-federate-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565851 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-metrics-client-ca\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.565901 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.565870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgdg4\" (UniqueName: \"kubernetes.io/projected/6741326f-0b94-45e6-b57c-0e7f09f87a99-kube-api-access-vgdg4\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.576055 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576028 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"1083b498db9e73afc6c6e04b1c823dd1d91ff5049acd36cb90aacb9c05b71d5d"} Jul 02 15:42:34.576407 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576093 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"f0be95c023b9a1b2451869975e4d1281333eaf8be330cf5f83e019a867ad925e"} Jul 02 15:42:34.576407 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"dbf22d7aa7ecc842d37dcfe970c89370d6bc1caf425ce5ab65f6a3be643eefb2"} Jul 02 15:42:34.576407 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576150 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"c10e99e9b04cc0a0c384ef13dc6a7080c46fe7df0a1410aa8032c7691bda9ed7"} Jul 02 15:42:34.576407 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"cf2638bf8262c850b75e244519aff136bd6a9d6f149473ed72011f912446f5ff"} Jul 02 15:42:34.576407 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.576197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"276f9a7c-8de5-4535-8127-2082d9d04e14","Type":"ContainerStarted","Data":"eb933c7fb6c3e00eee35bd3a322085ad96ee8476b60f5148aac8c4770d0be49e"} Jul 02 15:42:34.603686 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.602524 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.583747755 podStartE2EDuration="2.602503018s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.755263ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:42:34.601363567 +0000 UTC m=+162.239829288" watchObservedRunningTime="2026-07-02 15:42:34.602503018 +0000 UTC m=+162.240968739" Jul 02 15:42:34.666645 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.666810 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-serving-certs-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.666810 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.666810 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.666976 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.666976 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-federate-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.667065 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.666982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-metrics-client-ca\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.667065 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.667028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdg4\" (UniqueName: \"kubernetes.io/projected/6741326f-0b94-45e6-b57c-0e7f09f87a99-kube-api-access-vgdg4\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.667654 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.667622 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-serving-certs-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.667906 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.667843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-metrics-client-ca\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.668793 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.668768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.669891 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.669865 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.670072 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.670052 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-telemeter-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.670499 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.670470 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-secret-telemeter-client\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.670650 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.670629 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6741326f-0b94-45e6-b57c-0e7f09f87a99-federate-client-tls\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.677618 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.677582 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgdg4\" (UniqueName: \"kubernetes.io/projected/6741326f-0b94-45e6-b57c-0e7f09f87a99-kube-api-access-vgdg4\") pod \"telemeter-client-67d5f69869-5kg6z\" (UID: \"6741326f-0b94-45e6-b57c-0e7f09f87a99\") " pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.782051 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.781718 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" Jul 02 15:42:34.783009 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.782981 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:34.783433 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783343 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="prometheus" containerID="cri-o://d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" gracePeriod=600 Jul 02 15:42:34.783433 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783375 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy" containerID="cri-o://f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" gracePeriod=600 Jul 02 15:42:34.783560 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783462 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="thanos-sidecar" containerID="cri-o://0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" gracePeriod=600 Jul 02 15:42:34.783560 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783502 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" gracePeriod=600 Jul 02 15:42:34.783560 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783527 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-web" containerID="cri-o://22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" gracePeriod=600 Jul 02 15:42:34.783714 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.783502 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="config-reloader" containerID="cri-o://0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" gracePeriod=600 Jul 02 15:42:34.951526 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:34.951489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d5f69869-5kg6z"] Jul 02 15:42:34.954041 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:42:34.954010 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6741326f_0b94_45e6_b57c_0e7f09f87a99.slice/crio-9d287590dbd7b1abc3d546c1812c51633b28c361dc981359a756c508598c4650 WatchSource:0}: Error finding container 9d287590dbd7b1abc3d546c1812c51633b28c361dc981359a756c508598c4650: Status 404 returned error can't find the container with id 9d287590dbd7b1abc3d546c1812c51633b28c361dc981359a756c508598c4650 Jul 02 15:42:35.066222 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.065834 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.172754 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172722 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlwp4\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172754 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172757 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172785 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172839 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172865 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172895 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172928 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172960 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.172992 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.172988 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173027 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173053 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173084 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173109 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173136 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173167 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173200 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173230 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173287 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173326 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.173375 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.173357 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle\") pod \"1deb932e-8177-427d-8081-e193aea1e949\" (UID: \"1deb932e-8177-427d-8081-e193aea1e949\") " Jul 02 15:42:35.174555 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.174204 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.174697 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.174669 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.175032 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.174999 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.175145 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.175029 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.176218 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176117 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.176218 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176131 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4" (OuterVolumeSpecName: "kube-api-access-dlwp4") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "kube-api-access-dlwp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:42:35.176218 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176214 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.176446 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176299 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.176446 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176383 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:42:35.176663 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176639 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.176784 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176708 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.176784 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.176759 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:42:35.177340 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.177308 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.177665 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.177634 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config" (OuterVolumeSpecName: "config") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.177997 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.177977 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.178135 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.178111 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.178193 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.178138 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.178561 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.178538 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:42:35.178950 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.178934 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out" (OuterVolumeSpecName: "config-out") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:42:35.186575 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.186554 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config" (OuterVolumeSpecName: "web-config") pod "1deb932e-8177-427d-8081-e193aea1e949" (UID: "1deb932e-8177-427d-8081-e193aea1e949"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:42:35.274919 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274887 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.274919 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274914 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-db\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.274919 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274927 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274936 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274945 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274954 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-tls-assets\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274964 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1deb932e-8177-427d-8081-e193aea1e949-config-out\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274972 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-kube-rbac-proxy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274980 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274989 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-metrics-client-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.274997 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-grpc-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275004 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275012 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275020 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlwp4\" (UniqueName: \"kubernetes.io/projected/1deb932e-8177-427d-8081-e193aea1e949-kube-api-access-dlwp4\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275028 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275059 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-web-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275068 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275080 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275088 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1deb932e-8177-427d-8081-e193aea1e949-configmap-metrics-client-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.275152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.275098 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1deb932e-8177-427d-8081-e193aea1e949-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\"" Jul 02 15:42:35.583740 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.583637 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" event={"ID":"6741326f-0b94-45e6-b57c-0e7f09f87a99","Type":"ContainerStarted","Data":"9d287590dbd7b1abc3d546c1812c51633b28c361dc981359a756c508598c4650"} Jul 02 15:42:35.587884 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587855 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" exitCode=0 Jul 02 15:42:35.587884 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587884 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" exitCode=0 Jul 02 15:42:35.588085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587894 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" exitCode=0 Jul 02 15:42:35.588085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587902 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" exitCode=0 Jul 02 15:42:35.588085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587911 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" exitCode=0 Jul 02 15:42:35.588085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587919 2582 generic.go:356] "Generic (PLEG): container finished" podID="1deb932e-8177-427d-8081-e193aea1e949" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" exitCode=0 Jul 02 15:42:35.588085 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587959 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.588288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.587959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} Jul 02 15:42:35.588288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} Jul 02 15:42:35.588288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588223 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} Jul 02 15:42:35.588288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588271 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.588288 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588282 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} Jul 02 15:42:35.588506 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588324 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} Jul 02 15:42:35.588506 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} Jul 02 15:42:35.588506 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.588399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1deb932e-8177-427d-8081-e193aea1e949","Type":"ContainerDied","Data":"d66a3af190b202ea87cbaa86c0a251864caf51c4b22474331dfe95336311d4da"} Jul 02 15:42:35.598941 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.598920 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.607631 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.607589 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.614080 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.614056 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:35.617438 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.617418 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.618741 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.618715 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:35.625578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.625558 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.633474 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.633454 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.641076 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.641055 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.645457 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645435 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:35.645725 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645713 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="prometheus" Jul 02 15:42:35.645767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645727 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="prometheus" Jul 02 15:42:35.645767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645735 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy" Jul 02 15:42:35.645767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645740 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy" Jul 02 15:42:35.645767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645752 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="init-config-reloader" Jul 02 15:42:35.645767 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645758 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="init-config-reloader" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645771 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-thanos" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645776 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-thanos" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645782 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="thanos-sidecar" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645787 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="thanos-sidecar" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645795 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-web" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645799 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-web" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645806 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="config-reloader" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645811 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="config-reloader" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645854 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645861 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="thanos-sidecar" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645868 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="config-reloader" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645873 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-thanos" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645880 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="kube-rbac-proxy-web" Jul 02 15:42:35.645914 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.645887 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1deb932e-8177-427d-8081-e193aea1e949" containerName="prometheus" Jul 02 15:42:35.648318 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.648223 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.648587 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.648561 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.648653 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.648597 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.648653 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.648615 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.648870 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.648852 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.648945 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.648875 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.648945 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.648891 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.649156 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.649136 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.649223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649166 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.649223 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649189 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.649488 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.649471 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.649548 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649492 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.649548 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649506 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.649733 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.649715 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.649774 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649736 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.649774 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649749 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.649970 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.649953 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.650004 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649975 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.650004 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.649989 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.650122 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650110 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.650182 ip-10-0-141-101 kubenswrapper[2582]: E0702 15:42:35.650167 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.650221 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650186 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.650221 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650202 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.650502 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650476 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.650562 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650506 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.650750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650727 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.650750 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.650749 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.651024 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651003 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.651147 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651024 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.651254 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651217 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.651254 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651250 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.651485 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651467 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.651533 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651486 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.651716 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651699 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.651763 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651716 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.651921 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651904 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.651963 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.651922 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.652124 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652108 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.652171 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652123 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.652364 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652343 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.652364 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652363 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.652547 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652531 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:42:35.652635 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652601 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:42:35.652766 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652653 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.652766 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652676 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.652766 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:42:35.652766 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652746 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:42:35.653034 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.652877 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:42:35.653168 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653136 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.653168 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653163 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.653410 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653391 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.653476 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653411 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.653704 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653686 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.653781 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.653705 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.654200 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.654050 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.654200 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.654076 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.655933 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.654660 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.655933 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.654684 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.655933 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.655301 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-vcrv912e80a\"" Jul 02 15:42:35.656371 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:42:35.656371 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656197 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.656371 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656220 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.656585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656375 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:42:35.656585 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656422 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:42:35.656825 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656801 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:42:35.656950 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:42:35.656950 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656795 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.656950 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656912 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.657138 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.656961 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657214 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657256 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657315 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657448 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z5npn\"" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657592 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.657699 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657615 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.658256 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657867 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.658256 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.657889 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.658256 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658063 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:42:35.658256 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658261 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.658256 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658283 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.658621 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658588 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.658621 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658618 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.658880 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658864 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.658925 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.658882 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.659127 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659110 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.659198 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659127 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.659454 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659424 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.659454 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659450 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.659847 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659825 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.659847 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.659845 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.660069 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660050 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.660125 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660070 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.660349 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660322 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.660349 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660349 2582 scope.go:117] "RemoveContainer" containerID="b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef" Jul 02 15:42:35.660643 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660614 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef"} err="failed to get container status \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": rpc error: code = NotFound desc = could not find container \"b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef\": container with ID starting with b5836a94bf651aeb1a13e0c829c240887c8dc6ebb7a42e8e2989f98fab0a7bef not found: ID does not exist" Jul 02 15:42:35.660717 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660645 2582 scope.go:117] "RemoveContainer" containerID="f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd" Jul 02 15:42:35.660896 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660873 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd"} err="failed to get container status \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": rpc error: code = NotFound desc = could not find container \"f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd\": container with ID starting with f260512a321486fd6712913bc7cc8a99e88bd7bec4fe02d1f7ff9cdfb08050fd not found: ID does not exist" Jul 02 15:42:35.660942 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660899 2582 scope.go:117] "RemoveContainer" containerID="22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690" Jul 02 15:42:35.661006 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.660987 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:42:35.661184 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661159 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690"} err="failed to get container status \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": rpc error: code = NotFound desc = could not find container \"22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690\": container with ID starting with 22471fd2ded7c153a5149fe3348eadf4178a3ddf6ab08076a6e512cddccc1690 not found: ID does not exist" Jul 02 15:42:35.661251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661187 2582 scope.go:117] "RemoveContainer" containerID="0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05" Jul 02 15:42:35.661478 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661458 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05"} err="failed to get container status \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": rpc error: code = NotFound desc = could not find container \"0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05\": container with ID starting with 0900fbb0a443681277a011084b1c40c8970cae65905d00f4ab8d9977ab3e5f05 not found: ID does not exist" Jul 02 15:42:35.661530 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661479 2582 scope.go:117] "RemoveContainer" containerID="0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba" Jul 02 15:42:35.661693 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661675 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba"} err="failed to get container status \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": rpc error: code = NotFound desc = could not find container \"0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba\": container with ID starting with 0bade9783056de56d3d67e4ea4855b3d4c65fd3f9ae7c37ea92e48856b7355ba not found: ID does not exist" Jul 02 15:42:35.661748 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661693 2582 scope.go:117] "RemoveContainer" containerID="d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b" Jul 02 15:42:35.661915 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661899 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b"} err="failed to get container status \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": rpc error: code = NotFound desc = could not find container \"d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b\": container with ID starting with d44006ece6d40ebf738ef84488f0fd19ee75fd0cb82492cc2deab6d8055feb1b not found: ID does not exist" Jul 02 15:42:35.661953 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.661915 2582 scope.go:117] "RemoveContainer" containerID="ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870" Jul 02 15:42:35.662109 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.662094 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870"} err="failed to get container status \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": rpc error: code = NotFound desc = could not find container \"ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870\": container with ID starting with ad451ee105742734d35f86340187bb043109dd1e91fe50d7484d98646a2e4870 not found: ID does not exist" Jul 02 15:42:35.667369 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.667348 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:35.779020 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.778972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779020 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779278 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779183 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779542 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779578 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779832 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779832 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779832 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z5r5\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-kube-api-access-5z5r5\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.779832 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.779706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880129 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880129 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880598 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z5r5\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-kube-api-access-5z5r5\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.880848 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.880715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.881300 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.881063 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.881300 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.881099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.881300 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.881100 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.881466 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.881439 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.881543 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.881523 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.883421 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.883390 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.883552 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.883449 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.883552 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.883530 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.883855 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.883821 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-web-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.883969 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.883887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.884183 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.884160 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.884600 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.884565 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config-out\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.885094 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.885045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.885195 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.885090 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.885978 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.885950 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.886061 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.885954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.886225 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.886203 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.886357 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.886340 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-config\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.886765 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.886750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.891739 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.891719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z5r5\" (UniqueName: \"kubernetes.io/projected/c478d62d-84e1-41c4-bb5c-dcbaa13301b9-kube-api-access-5z5r5\") pod \"prometheus-k8s-0\" (UID: \"c478d62d-84e1-41c4-bb5c-dcbaa13301b9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:35.962666 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:35.962626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:42:36.118746 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:36.118718 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:42:36.120807 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:42:36.120775 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc478d62d_84e1_41c4_bb5c_dcbaa13301b9.slice/crio-afb68870cb617ac1cc7d71e5c5d631ee2a492ffc595430e265bedc78c3d81911 WatchSource:0}: Error finding container afb68870cb617ac1cc7d71e5c5d631ee2a492ffc595430e265bedc78c3d81911: Status 404 returned error can't find the container with id afb68870cb617ac1cc7d71e5c5d631ee2a492ffc595430e265bedc78c3d81911 Jul 02 15:42:36.594952 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:36.594869 2582 generic.go:356] "Generic (PLEG): container finished" podID="c478d62d-84e1-41c4-bb5c-dcbaa13301b9" containerID="e7de361f7ba96588ef820066fc8a381e55ef5c18ac7a97affb46ad7a8b0f66da" exitCode=0 Jul 02 15:42:36.594952 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:36.594927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerDied","Data":"e7de361f7ba96588ef820066fc8a381e55ef5c18ac7a97affb46ad7a8b0f66da"} Jul 02 15:42:36.595426 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:36.594999 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"afb68870cb617ac1cc7d71e5c5d631ee2a492ffc595430e265bedc78c3d81911"} Jul 02 15:42:36.775577 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:36.775516 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1deb932e-8177-427d-8081-e193aea1e949" path="/var/lib/kubelet/pods/1deb932e-8177-427d-8081-e193aea1e949/volumes" Jul 02 15:42:37.600967 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.600870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" event={"ID":"6741326f-0b94-45e6-b57c-0e7f09f87a99","Type":"ContainerStarted","Data":"f594f158d9f7af2c10fa6302a1843142ab4d7f69ce746832da5429e48459be28"} Jul 02 15:42:37.600967 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.600935 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" event={"ID":"6741326f-0b94-45e6-b57c-0e7f09f87a99","Type":"ContainerStarted","Data":"788d55d99fc0dd1a6560101f85b2023252e3c0813044da971f2382461f770f27"} Jul 02 15:42:37.600967 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.600957 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" event={"ID":"6741326f-0b94-45e6-b57c-0e7f09f87a99","Type":"ContainerStarted","Data":"cb2c7e1ae1cd76fda74d4c8d29b8443563a56e4a955a3a3b63bff5f8535550f8"} Jul 02 15:42:37.603883 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.603862 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"2eca04fe3561f3f7350c84bf2e4a1998488979b8d6c413ab2728624233c6bae1"} Jul 02 15:42:37.603977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.603913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"cf456cfec133328fb6e51050b910fbacc8bdfe17635e8b541a5d57098475355a"} Jul 02 15:42:37.603977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.603939 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"01784f78768494bd1112f0c5382e422ef4605b8d9daa1203196038cf7479a667"} Jul 02 15:42:37.603977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.603965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"ecad06eae03d02abd963abdd777501d91779c973bfc5251e6c52e33a589538b1"} Jul 02 15:42:37.604061 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.603992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"f6b546791afa563b37766819d2acd8cbf066f2d5a9638662f58836dbfd36503c"} Jul 02 15:42:37.604061 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.604020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c478d62d-84e1-41c4-bb5c-dcbaa13301b9","Type":"ContainerStarted","Data":"6c1aa0edf990a9181390017090fe95c5dbd856e444229e73ee37ee2ba2f5e74a"} Jul 02 15:42:37.625650 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.625568 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67d5f69869-5kg6z" podStartSLOduration=1.30455904 podStartE2EDuration="3.625552296s" totalImagesPullingTime="2.320993256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:42:37.62478775 +0000 UTC m=+165.263253470" watchObservedRunningTime="2026-07-02 15:42:37.625552296 +0000 UTC m=+165.264017993" Jul 02 15:42:37.658194 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:37.658137 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.634777541 podStartE2EDuration="2.658119823s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.342282ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:42:37.65616603 +0000 UTC m=+165.294631750" watchObservedRunningTime="2026-07-02 15:42:37.658119823 +0000 UTC m=+165.296585542" Jul 02 15:42:40.963698 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:42:40.963655 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:43:35.963703 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:43:35.963660 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:43:35.979148 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:43:35.979119 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:43:36.846782 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:43:36.846749 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:44:52.729985 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:52.729962 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:44:58.057302 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.057270 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9nbbr/must-gather-n4t5t"] Jul 02 15:44:58.060338 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.060323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.062988 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.062969 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9nbbr\"/\"default-dockercfg-wtln5\"" Jul 02 15:44:58.063972 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.063953 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9nbbr\"/\"kube-root-ca.crt\"" Jul 02 15:44:58.064187 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.064172 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9nbbr\"/\"openshift-service-ca.crt\"" Jul 02 15:44:58.069213 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.069187 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nbbr/must-gather-n4t5t"] Jul 02 15:44:58.206325 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.206290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcvh\" (UniqueName: \"kubernetes.io/projected/f6038e41-a37c-4a26-b90d-81b7579ab677-kube-api-access-thcvh\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.206325 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.206333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6038e41-a37c-4a26-b90d-81b7579ab677-must-gather-output\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.307228 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.307192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thcvh\" (UniqueName: \"kubernetes.io/projected/f6038e41-a37c-4a26-b90d-81b7579ab677-kube-api-access-thcvh\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.307441 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.307258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6038e41-a37c-4a26-b90d-81b7579ab677-must-gather-output\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.307604 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.307584 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6038e41-a37c-4a26-b90d-81b7579ab677-must-gather-output\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.316704 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.316682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcvh\" (UniqueName: \"kubernetes.io/projected/f6038e41-a37c-4a26-b90d-81b7579ab677-kube-api-access-thcvh\") pod \"must-gather-n4t5t\" (UID: \"f6038e41-a37c-4a26-b90d-81b7579ab677\") " pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.378778 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.378740 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" Jul 02 15:44:58.501461 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.501437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nbbr/must-gather-n4t5t"] Jul 02 15:44:58.504079 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:44:58.504038 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6038e41_a37c_4a26_b90d_81b7579ab677.slice/crio-ef4b8732e16280d6da24f22c9816364be5055fe746cf6ebf48878db947c88e84 WatchSource:0}: Error finding container ef4b8732e16280d6da24f22c9816364be5055fe746cf6ebf48878db947c88e84: Status 404 returned error can't find the container with id ef4b8732e16280d6da24f22c9816364be5055fe746cf6ebf48878db947c88e84 Jul 02 15:44:58.505899 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:58.505885 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:44:59.146465 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:44:59.146431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" event={"ID":"f6038e41-a37c-4a26-b90d-81b7579ab677","Type":"ContainerStarted","Data":"ef4b8732e16280d6da24f22c9816364be5055fe746cf6ebf48878db947c88e84"} Jul 02 15:45:00.152850 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.152819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" event={"ID":"f6038e41-a37c-4a26-b90d-81b7579ab677","Type":"ContainerStarted","Data":"c7f051b4f95ea624313e7e2d3751b57615aafc7d80d98ffedbcbc6920e48cdb5"} Jul 02 15:45:00.153215 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.152861 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" event={"ID":"f6038e41-a37c-4a26-b90d-81b7579ab677","Type":"ContainerStarted","Data":"ef80ec47cedeeaf1db4943112b02d0c180a5bd3bec101a1439d3f65f38031856"} Jul 02 15:45:00.171084 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.171024 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9nbbr/must-gather-n4t5t" podStartSLOduration=1.344002476 podStartE2EDuration="2.171002677s" totalImagesPullingTime="827.000201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:45:00.169454275 +0000 UTC m=+307.807919994" watchObservedRunningTime="2026-07-02 15:45:00.171002677 +0000 UTC m=+307.809468398" Jul 02 15:45:00.649012 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.648975 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dnf8z_3e88ecf7-fef2-466d-a01a-e1664d827f3d/global-pull-secret-syncer/0.log" Jul 02 15:45:00.800152 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.800123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-spr9h_1a767b0c-e094-4c96-b7d2-6c7fc738af55/konnectivity-agent/0.log" Jul 02 15:45:00.846391 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:00.846357 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-101.ec2.internal_9e6f752c07e5632ae220e7980f2a66a5/haproxy/0.log" Jul 02 15:45:04.573831 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.573804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/alertmanager/0.log" Jul 02 15:45:04.599018 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.598994 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/config-reloader/0.log" Jul 02 15:45:04.629896 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.629845 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/kube-rbac-proxy-web/0.log" Jul 02 15:45:04.691255 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.691143 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/kube-rbac-proxy/0.log" Jul 02 15:45:04.716683 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.716657 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/kube-rbac-proxy-metric/0.log" Jul 02 15:45:04.743832 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.743804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/prom-label-proxy/0.log" Jul 02 15:45:04.770974 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.770918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_276f9a7c-8de5-4535-8127-2082d9d04e14/init-config-reloader/0.log" Jul 02 15:45:04.808488 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.808458 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-x7tch_ebc93b26-7002-4e08-b02f-43e43306f770/cluster-monitoring-operator/0.log" Jul 02 15:45:04.924393 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.923954 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7db9f9ff9d-rjpws_899ce431-c4d5-4b2c-9bcb-fbaa753a06cc/metrics-server/0.log" Jul 02 15:45:04.952688 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.952583 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-2z2s7_fc167e75-fc5c-4cf8-ad99-760f19c02e02/monitoring-plugin/0.log" Jul 02 15:45:04.990203 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:04.990176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdxnl_a14704df-4a48-4c06-9897-0bf508210d95/node-exporter/0.log" Jul 02 15:45:05.012536 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.012483 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdxnl_a14704df-4a48-4c06-9897-0bf508210d95/kube-rbac-proxy/0.log" Jul 02 15:45:05.034000 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.033975 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bdxnl_a14704df-4a48-4c06-9897-0bf508210d95/init-textfile/0.log" Jul 02 15:45:05.225836 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.225751 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-g5k8c_572db80f-0a12-4493-bd44-e5c3b6cafd2c/kube-rbac-proxy-main/0.log" Jul 02 15:45:05.248332 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.248301 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-g5k8c_572db80f-0a12-4493-bd44-e5c3b6cafd2c/kube-rbac-proxy-self/0.log" Jul 02 15:45:05.278705 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.278677 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-g5k8c_572db80f-0a12-4493-bd44-e5c3b6cafd2c/openshift-state-metrics/0.log" Jul 02 15:45:05.314020 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.313934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/prometheus/0.log" Jul 02 15:45:05.341088 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.341052 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/config-reloader/0.log" Jul 02 15:45:05.364716 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.364686 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/thanos-sidecar/0.log" Jul 02 15:45:05.389477 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.389452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/kube-rbac-proxy-web/0.log" Jul 02 15:45:05.412075 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.412047 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/kube-rbac-proxy/0.log" Jul 02 15:45:05.434758 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.434730 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/kube-rbac-proxy-thanos/0.log" Jul 02 15:45:05.455968 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.455940 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c478d62d-84e1-41c4-bb5c-dcbaa13301b9/init-config-reloader/0.log" Jul 02 15:45:05.485338 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.485260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-8bhz5_a84eb7e8-7db0-445b-9e79-95591ceb2d40/prometheus-operator/0.log" Jul 02 15:45:05.504916 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.504880 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-8bhz5_a84eb7e8-7db0-445b-9e79-95591ceb2d40/kube-rbac-proxy/0.log" Jul 02 15:45:05.537715 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.537685 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-tc9k2_3d222f90-1ccf-476c-a0bb-0f784a6d9aae/prometheus-operator-admission-webhook/0.log" Jul 02 15:45:05.564959 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.564918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5f69869-5kg6z_6741326f-0b94-45e6-b57c-0e7f09f87a99/telemeter-client/0.log" Jul 02 15:45:05.589878 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.589849 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5f69869-5kg6z_6741326f-0b94-45e6-b57c-0e7f09f87a99/reload/0.log" Jul 02 15:45:05.612643 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:05.612613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d5f69869-5kg6z_6741326f-0b94-45e6-b57c-0e7f09f87a99/kube-rbac-proxy/0.log" Jul 02 15:45:08.323717 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.323682 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc"] Jul 02 15:45:08.329507 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.329474 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.336965 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.336940 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc"] Jul 02 15:45:08.504251 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.504204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-podres\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.504435 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.504286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-lib-modules\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.504435 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.504361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-proc\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.504435 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.504416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmsjx\" (UniqueName: \"kubernetes.io/projected/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-kube-api-access-dmsjx\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.504571 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.504448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-sys\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605801 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-podres\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605813 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-lib-modules\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-proc\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605904 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-proc\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmsjx\" (UniqueName: \"kubernetes.io/projected/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-kube-api-access-dmsjx\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605943 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-podres\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605955 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-lib-modules\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.605977 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.605964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-sys\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.606355 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.606036 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-sys\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.614689 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.614661 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmsjx\" (UniqueName: \"kubernetes.io/projected/3246075f-7be8-4f6d-938e-a7ca5b5e7fd0-kube-api-access-dmsjx\") pod \"perf-node-gather-daemonset-46zrc\" (UID: \"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0\") " pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.642770 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.642743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:08.793776 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:08.793752 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc"] Jul 02 15:45:08.797875 ip-10-0-141-101 kubenswrapper[2582]: W0702 15:45:08.797829 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3246075f_7be8_4f6d_938e_a7ca5b5e7fd0.slice/crio-f20831e070ea19cb46072851c2444f4d23ebcfd0d705f3cd01e8ef0876c77641 WatchSource:0}: Error finding container f20831e070ea19cb46072851c2444f4d23ebcfd0d705f3cd01e8ef0876c77641: Status 404 returned error can't find the container with id f20831e070ea19cb46072851c2444f4d23ebcfd0d705f3cd01e8ef0876c77641 Jul 02 15:45:09.199697 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.199629 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tdgp_cbd0fa6a-2d3b-491f-8e9b-398640396146/dns/0.log" Jul 02 15:45:09.202484 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.202457 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" event={"ID":"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0","Type":"ContainerStarted","Data":"02b713a3d0c21dfdf695dacede51a23bf5a43f6760db54debcb2b11c43b4d687"} Jul 02 15:45:09.202606 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.202512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" event={"ID":"3246075f-7be8-4f6d-938e-a7ca5b5e7fd0","Type":"ContainerStarted","Data":"f20831e070ea19cb46072851c2444f4d23ebcfd0d705f3cd01e8ef0876c77641"} Jul 02 15:45:09.202606 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.202594 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:09.217805 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.217757 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" podStartSLOduration=1.217744031 podStartE2EDuration="1.217744031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:45:09.216624505 +0000 UTC m=+316.855090224" watchObservedRunningTime="2026-07-02 15:45:09.217744031 +0000 UTC m=+316.856209749" Jul 02 15:45:09.223428 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.223406 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tdgp_cbd0fa6a-2d3b-491f-8e9b-398640396146/kube-rbac-proxy/0.log" Jul 02 15:45:09.336490 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.336462 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m92vz_bcd80b58-46d4-4b74-a10b-3c3005ff31a0/dns-node-resolver/0.log" Jul 02 15:45:09.807880 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:09.807851 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrjr4_e1c55688-3a8a-40ce-9aa6-9cd1b3fffb32/node-ca/0.log" Jul 02 15:45:10.769318 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:10.769293 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7d7mt_ea79554b-e4d3-4a85-8eb0-fb2d271d359f/serve-healthcheck-canary/0.log" Jul 02 15:45:11.129997 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:11.129969 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-s8m66_6734c282-b9b3-4872-9753-afe860adfb32/insights-operator/0.log" Jul 02 15:45:11.153887 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:11.153857 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bvcb_c62056ae-e037-40ce-b3f6-e9960d7b3b9e/kube-rbac-proxy/0.log" Jul 02 15:45:11.175603 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:11.175584 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bvcb_c62056ae-e037-40ce-b3f6-e9960d7b3b9e/exporter/0.log" Jul 02 15:45:11.203048 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:11.203022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8bvcb_c62056ae-e037-40ce-b3f6-e9960d7b3b9e/extractor/0.log" Jul 02 15:45:15.216635 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:15.216607 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9nbbr/perf-node-gather-daemonset-46zrc" Jul 02 15:45:16.432553 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.432521 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/kube-multus-additional-cni-plugins/0.log" Jul 02 15:45:16.454116 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.454087 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/egress-router-binary-copy/0.log" Jul 02 15:45:16.476995 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.476958 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/cni-plugins/0.log" Jul 02 15:45:16.499280 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.499226 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/bond-cni-plugin/0.log" Jul 02 15:45:16.520680 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.520654 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/routeoverride-cni/0.log" Jul 02 15:45:16.541410 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.541390 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/whereabouts-cni-bincopy/0.log" Jul 02 15:45:16.564467 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.564442 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sp5hw_0c4fe1e5-03ee-4cc7-81a4-a08e8bfda384/whereabouts-cni/0.log" Jul 02 15:45:16.627435 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.627376 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rs4vl_9eb504b1-f539-4e72-b213-7679fa7ae57d/kube-multus/0.log" Jul 02 15:45:16.737940 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.737812 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rbfgf_7202620c-7799-4d63-b697-84be2251725c/network-metrics-daemon/0.log" Jul 02 15:45:16.757942 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:16.757915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rbfgf_7202620c-7799-4d63-b697-84be2251725c/kube-rbac-proxy/0.log" Jul 02 15:45:17.670734 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.670661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/ovn-controller/0.log" Jul 02 15:45:17.692693 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.692652 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/ovn-acl-logging/0.log" Jul 02 15:45:17.716394 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.716319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/kube-rbac-proxy-node/0.log" Jul 02 15:45:17.738863 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.738841 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 15:45:17.764116 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.764052 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/northd/0.log" Jul 02 15:45:17.785097 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.785073 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/nbdb/0.log" Jul 02 15:45:17.805108 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.805078 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/sbdb/0.log" Jul 02 15:45:17.843312 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:17.843286 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fhv7x_0221ebc3-f732-4ee5-a58b-6df70dc786db/ovnkube-controller/0.log" Jul 02 15:45:19.294172 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:19.294141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ptmqv_f0388d88-6126-4ed0-b370-52602d20e634/network-check-target-container/0.log" Jul 02 15:45:20.275554 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:20.275516 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qmhdv_d2b77ff5-786a-4832-a6b4-8bee1f403fbb/iptables-alerter/0.log" Jul 02 15:45:20.941412 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:20.941388 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sbwll_5e18112d-a643-4cd8-91da-c7aded43cbf7/tuned/0.log" Jul 02 15:45:24.168638 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:24.168613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-pl2mw_2740bb7f-70a3-43bd-94a8-2d9b2379256e/csi-driver/0.log" Jul 02 15:45:24.190889 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:24.190865 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-pl2mw_2740bb7f-70a3-43bd-94a8-2d9b2379256e/csi-node-driver-registrar/0.log" Jul 02 15:45:24.210556 ip-10-0-141-101 kubenswrapper[2582]: I0702 15:45:24.210531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-pl2mw_2740bb7f-70a3-43bd-94a8-2d9b2379256e/csi-liveness-probe/0.log"