Jul 03 17:32:48.663959 ip-10-0-138-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 03 17:32:48.663969 ip-10-0-138-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 03 17:32:48.663976 ip-10-0-138-0 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 03 17:32:48.664191 ip-10-0-138-0 systemd[1]: Failed to start Kubernetes Kubelet. Jul 03 17:32:58.345038 ip-10-0-138-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 03 17:32:58.345052 ip-10-0-138-0 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3e36bf2c74d344c08bf06d3d8c744e5a -- Jul 03 17:34:27.187677 ip-10-0-138-0 systemd[1]: Starting Kubernetes Kubelet... Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 17:34:27.591178 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.584203 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591335 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591350 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591353 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591357 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591362 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591365 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591367 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591387 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591395 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591399 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591402 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591405 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591407 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591412 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591415 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591418 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591421 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591423 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591426 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:27.606059 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591430 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591437 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591440 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591443 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591446 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591450 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591453 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591456 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591459 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591462 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591464 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591467 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591470 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591473 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591479 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591482 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591485 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591488 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591490 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:27.607866 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591493 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591497 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591501 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591504 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591507 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591510 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591517 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591520 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591523 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591526 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591529 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591532 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591535 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591538 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591541 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591543 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591546 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591549 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591554 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591557 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:27.609981 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591560 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591565 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591569 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591572 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591576 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591579 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591582 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591585 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591587 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591590 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591595 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591598 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591601 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591603 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591606 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591608 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591611 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591614 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591616 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:27.621625 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591619 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591622 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591625 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591627 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591632 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591635 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591638 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591640 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591643 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591646 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591648 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591651 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591653 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591656 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591661 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591666 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591669 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591672 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591674 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:27.624279 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591677 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.591680 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592629 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592637 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592640 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592643 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592646 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592649 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592652 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592654 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592657 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592660 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592663 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592665 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592668 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592670 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592673 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592676 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592679 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592683 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:27.677107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592686 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:27.661502 ip-10-0-138-0 systemd[1]: Started Kubernetes Kubelet. Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592688 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592691 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592693 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592696 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592698 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592701 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592704 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592707 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592709 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592714 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592716 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592719 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592722 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592725 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592728 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592730 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592733 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592735 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592738 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:27.679761 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592740 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592743 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592746 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592748 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592751 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592753 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592756 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592760 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592763 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592766 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592769 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592773 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592776 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592780 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592783 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592786 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592788 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592794 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:27.920233 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592796 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592798 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592801 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592805 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592808 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592810 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592813 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592816 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592818 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592821 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592823 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592826 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592828 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592832 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592835 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592838 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592842 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592845 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592847 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:27.933113 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592850 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592853 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592856 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592860 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592862 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592866 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592870 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592873 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592875 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592878 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592881 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592883 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592886 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592888 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592890 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592893 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592897 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592900 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592903 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592906 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:27.934060 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592908 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592911 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.592913 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593297 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593302 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593304 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593307 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593309 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593312 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593314 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593317 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593319 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593322 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593324 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593327 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593330 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593332 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593336 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593339 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593342 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:27.934920 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593345 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593347 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593350 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593353 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593355 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593358 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593360 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593363 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593407 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593412 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593415 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593418 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593420 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593423 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593427 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593431 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593434 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593437 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593440 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:27.935584 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593443 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593445 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593448 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593450 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593453 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593456 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593458 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593461 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593463 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593465 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593470 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593472 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593475 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593478 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593480 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593483 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593485 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593488 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593490 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593493 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:27.936177 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593495 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593499 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593502 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593505 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593509 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593512 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593514 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593517 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593519 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593521 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593524 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593527 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593529 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593533 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593536 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593539 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593542 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593544 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593546 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:27.936867 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593549 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593553 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593556 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593560 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593563 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593565 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593568 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593572 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593574 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593577 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593580 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593582 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593585 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593587 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593591 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593593 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593596 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593598 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593601 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593604 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:27.937515 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593606 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593608 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593611 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.593613 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593676 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593683 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593690 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593695 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593702 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593707 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593713 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593719 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593722 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593725 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593728 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593734 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593737 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593740 2578 flags.go:64] FLAG: --cgroup-root="" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593742 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593745 2578 flags.go:64] FLAG: --client-ca-file="" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593749 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593752 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593757 2578 flags.go:64] FLAG: --cluster-domain="" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593759 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 17:34:27.938107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593763 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593766 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593770 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593774 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593777 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593780 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593783 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593786 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593789 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593792 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593795 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593798 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593802 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593805 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593808 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593811 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593814 2578 flags.go:64] FLAG: --enable-server="true" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593817 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593821 2578 flags.go:64] FLAG: --event-burst="100" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593824 2578 flags.go:64] FLAG: --event-qps="50" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593827 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593830 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593833 2578 flags.go:64] FLAG: --eviction-hard="" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593839 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 17:34:27.938939 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593842 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593844 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593847 2578 flags.go:64] FLAG: --eviction-soft="" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593850 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593853 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593857 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593860 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593862 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593866 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593868 2578 flags.go:64] FLAG: --feature-gates="" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593874 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593877 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593881 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593884 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593887 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593890 2578 flags.go:64] FLAG: --help="false" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593892 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-0.ec2.internal" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593895 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593898 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593901 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593904 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593908 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593910 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 17:34:27.939643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593913 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593916 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593919 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593922 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593925 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593927 2578 flags.go:64] FLAG: --kube-reserved="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593930 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593933 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593937 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593940 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593943 2578 flags.go:64] FLAG: --lock-file="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593945 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593948 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593951 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593956 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593960 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593963 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593966 2578 flags.go:64] FLAG: --logging-format="text" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593968 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593973 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593976 2578 flags.go:64] FLAG: --manifest-url="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593979 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593983 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593986 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593990 2578 flags.go:64] FLAG: --max-pods="110" Jul 03 17:34:27.940359 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593993 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593996 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.593999 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594002 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594004 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594008 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594010 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594018 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594021 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594025 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594027 2578 flags.go:64] FLAG: --pod-cidr="" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594030 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594036 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594039 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594042 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594045 2578 flags.go:64] FLAG: --port="10250" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594049 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594052 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c41293d8331ad06" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594055 2578 flags.go:64] FLAG: --qos-reserved="" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594058 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594061 2578 flags.go:64] FLAG: --register-node="true" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594064 2578 flags.go:64] FLAG: --register-with-taints="" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594067 2578 flags.go:64] FLAG: --registry-burst="10" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594070 2578 flags.go:64] FLAG: --registry-qps="5" Jul 03 17:34:27.941641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594073 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594076 2578 flags.go:64] FLAG: --reserved-memory="" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594080 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594083 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594086 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594089 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594092 2578 flags.go:64] FLAG: --runonce="false" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594095 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594098 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594101 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594103 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594106 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594109 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594112 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594115 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594118 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594120 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594123 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594126 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594129 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594131 2578 flags.go:64] FLAG: --system-cgroups="" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594134 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594139 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594142 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594146 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 17:34:27.942744 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594150 2578 flags.go:64] FLAG: --tls-min-version="" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594153 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594156 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594159 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594162 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594165 2578 flags.go:64] FLAG: --v="2" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594168 2578 flags.go:64] FLAG: --version="false" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594173 2578 flags.go:64] FLAG: --vmodule="" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594177 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.594181 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594295 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594299 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594302 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594305 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594308 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594310 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594313 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594315 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594318 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594320 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594323 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594326 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:27.943841 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594328 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594331 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594334 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594336 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594339 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594341 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594344 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594346 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594349 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594352 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594355 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594358 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594361 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594363 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594366 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594386 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594392 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594396 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594400 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594405 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:27.944933 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594408 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594412 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594414 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594417 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594420 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594422 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594425 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594427 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594430 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594433 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594435 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594437 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594440 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594443 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594445 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594448 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594450 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594452 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594455 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594457 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:27.946017 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594460 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594464 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594466 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594469 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594471 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594474 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594477 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594479 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594482 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594485 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594487 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594491 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594494 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594496 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594499 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594501 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594504 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594507 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594509 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:27.946892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594512 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594515 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594517 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594520 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594522 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594524 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594527 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594530 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594532 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594536 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594539 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594542 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594545 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594548 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594553 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594555 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594558 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594560 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594563 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:27.947771 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594565 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594568 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594571 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594574 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594578 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594582 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594585 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594588 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.594590 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.595163 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.602185 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.602199 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.602943 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.602956 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603014 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:27.948654 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603019 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603023 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603026 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603029 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603032 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603035 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603038 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603041 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603044 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603047 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603049 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603052 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603055 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603057 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603060 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603062 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603065 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603068 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603070 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603073 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:27.951661 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603075 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603078 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603081 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603083 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603086 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603089 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603091 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603094 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603098 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603100 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603103 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603105 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603108 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603111 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603113 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603116 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603118 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603121 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603124 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603127 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:27.952746 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603129 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603131 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603134 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603137 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603139 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603144 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603146 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603149 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603152 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603155 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603159 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603162 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603165 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603168 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603171 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603173 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603176 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603179 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603182 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:28.072758 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603184 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603187 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603190 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603192 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603195 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603198 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603200 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603203 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603206 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603209 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603213 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603216 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603218 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603221 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603224 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603226 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603229 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603231 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603236 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:28.073834 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603239 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603242 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603244 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603247 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603249 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603252 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603254 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603259 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603262 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603265 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603269 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603272 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603275 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603278 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603281 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603284 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603287 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603290 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:28.074702 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603293 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.603301 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603431 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603437 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603440 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603443 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603446 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603449 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603452 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603455 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603457 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603460 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603462 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603466 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 17:34:28.075577 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603470 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603474 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603477 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603480 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603482 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603485 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603488 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603490 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603493 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603495 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603498 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603500 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603503 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603505 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603508 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603512 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603515 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603518 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 17:34:28.076229 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603522 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603526 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603529 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603532 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603534 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603536 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603539 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603542 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603544 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603546 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603549 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603551 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603554 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603557 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603561 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603563 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603566 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603568 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603571 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603573 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 17:34:28.077117 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603576 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603578 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603581 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603583 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603586 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603588 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603591 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603593 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603596 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603599 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603601 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603607 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603609 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603613 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603616 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603618 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603621 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603623 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603626 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603628 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 17:34:28.078005 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603631 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603633 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603635 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603638 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603641 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603644 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603647 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603649 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603652 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603654 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603657 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603660 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603662 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603665 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603667 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603670 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603672 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603675 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603677 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603680 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 17:34:28.079087 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603682 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603685 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603688 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603690 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603693 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603697 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603699 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603702 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:27.603705 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.603710 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.603810 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.605666 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.606968 2578 server.go:1019] "Starting client certificate rotation" Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.607075 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 17:34:28.080180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.607110 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.610092 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.612122 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.621714 2578 log.go:25] "Validated CRI v1 runtime API" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.624722 2578 log.go:25] "Validated CRI v1 image API" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.625626 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.630474 2578 fs.go:135] Filesystem UUIDs: map[3f51dce4-a3a8-4c75-a513-4b79c2f57db1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cfdddc84-53b8-4f7a-9ad6-3c8471d801c0:/dev/nvme0n1p3] Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.630490 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 17:34:28.081053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.637386 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.637434 2578 manager.go:216] Machine: {Timestamp:2026-07-03 17:34:27.63599526 +0000 UTC m=+0.330092447 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099986 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec202bae5bd9664dd2faa19ae399e3f9 SystemUUID:ec202bae-5bd9-664d-d2fa-a19ae399e3f9 BootID:3e36bf2c-74d3-44c0-8bf0-6d3d8c744e5a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:a3:00:6a:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:a3:00:6a:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:e4:ec:06:d4:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.637542 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.637636 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.640951 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.640983 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.642694 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.642712 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.642723 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.643556 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.645141 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648761 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648880 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648908 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648917 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648934 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648947 2578 kubelet.go:398] "Adding apiserver pod source" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.648955 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 17:34:28.081715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.649266 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.649283 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.653081 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.655626 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.655654 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.656954 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.656968 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.656975 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.656980 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657023 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657031 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657040 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657054 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657061 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657067 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657080 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657105 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657131 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.657137 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.660528 2578 server.go:1268] "Started kubelet" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.660586 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.660627 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.660719 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.662248 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.662256 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.662408 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.662534 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.662856 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.667455 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.667959 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18bed81073dd68b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-03 17:34:27.660261561 +0000 UTC m=+0.354358748,LastTimestamp:2026-07-03 17:34:27.660261561 +0000 UTC m=+0.354358748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.671526 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.671537 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.671583 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672258 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672274 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672410 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672425 2578 factory.go:55] Registering systemd factory Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672439 2578 factory.go:223] Registration of the systemd container factory successfully Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672453 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.672463 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674258 2578 factory.go:153] Registering CRI-O factory Jul 03 17:34:28.082611 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674277 2578 factory.go:223] Registration of the crio container factory successfully Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674334 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674360 2578 factory.go:103] Registering Raw factory Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674401 2578 manager.go:1196] Started watching for new ooms in manager Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.674458 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.674574 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.674769 2578 manager.go:349] Starting recovery of all containers Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.687060 2578 manager.go:354] Recovery completed Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.691768 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.693654 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.693687 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.693698 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694232 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694249 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694252 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694312 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694835 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qt46j" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694927 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694952 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.694965 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.695441 2578 policy_none.go:49] "None policy: Start" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.695454 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.695464 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.695913 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18bed81075db3bac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-03 17:34:27.693673388 +0000 UTC m=+0.387770575,LastTimestamp:2026-07-03 17:34:27.693673388 +0000 UTC m=+0.387770575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.696599 2578 policy_none.go:47] "Start" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.703319 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qt46j" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.703543 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18bed81075db84ba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-03 17:34:27.69369209 +0000 UTC m=+0.387789276,LastTimestamp:2026-07-03 17:34:27.69369209 +0000 UTC m=+0.387789276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.758911 2578 manager.go:337] "Starting Device Plugin manager" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.758941 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.758951 2578 server.go:87] "Starting device plugin registration server" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.759184 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.759193 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 17:34:28.084346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.759324 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.759415 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.759425 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.759874 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.759919 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.775602 2578 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2614 into the system container \"/system.slice\": " Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.859710 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.860865 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.860897 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.860911 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.860945 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.870731 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.870751 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-0.ec2.internal\": node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.901821 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.930348 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.931689 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.931724 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.931752 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:27.931794 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:27.934657 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.002567 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.032728 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"] Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.032831 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.033831 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.033859 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.033874 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.035575 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.035716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.035741 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036314 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036336 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036346 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036408 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036427 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.036435 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.037723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.037747 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.038515 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.038535 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.038547 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.085671 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.059231 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.087635 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.063014 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.087635 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.079184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.087635 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.079206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.087635 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.079224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0854266c70379aa8ce321ab152e516e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"a0854266c70379aa8ce321ab152e516e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.102682 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0854266c70379aa8ce321ab152e516e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"a0854266c70379aa8ce321ab152e516e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0854266c70379aa8ce321ab152e516e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"a0854266c70379aa8ce321ab152e516e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.179625 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c650d7b90f9cfab0129bb7ed79b977-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"19c650d7b90f9cfab0129bb7ed79b977\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.227956 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.203570 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.333321 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.304066 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.427903 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.364241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.427903 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.366409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:28.427903 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.404956 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.554862 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.505486 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.699961 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.605960 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.699961 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.606007 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 17:34:28.699961 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.606137 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 17:34:28.706621 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.706137 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.706621 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.706125 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 17:29:28 +0000 UTC" deadline="2028-02-20 08:36:56.230988206 +0000 UTC" Jul 03 17:34:28.706621 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.706169 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14319h2m27.524823981s" Jul 03 17:34:28.818835 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.806394 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:28.818835 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.810602 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.834913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.834959 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.834976 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.841669 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.859559 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:28.911349 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:28.906476 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:29.047892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:28.938743 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0854266c70379aa8ce321ab152e516e.slice/crio-64999e101bcb3791afa313d09b36f419a79075e3b65ffbcb6d8e75ee0a508955 WatchSource:0}: Error finding container 64999e101bcb3791afa313d09b36f419a79075e3b65ffbcb6d8e75ee0a508955: Status 404 returned error can't find the container with id 64999e101bcb3791afa313d09b36f419a79075e3b65ffbcb6d8e75ee0a508955 Jul 03 17:34:29.047892 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:28.939131 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c650d7b90f9cfab0129bb7ed79b977.slice/crio-c522fc8e31a3c6c2be26707cda49880751d592dae139fd2d3d594f2e05d63fe9 WatchSource:0}: Error finding container c522fc8e31a3c6c2be26707cda49880751d592dae139fd2d3d594f2e05d63fe9: Status 404 returned error can't find the container with id c522fc8e31a3c6c2be26707cda49880751d592dae139fd2d3d594f2e05d63fe9 Jul 03 17:34:29.047892 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:28.946099 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 17:34:29.047892 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.009073 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found" Jul 03 17:34:29.047892 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.029028 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:29.152118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.074492 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" Jul 03 17:34:29.152118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.087359 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 17:34:29.152118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.088635 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" Jul 03 17:34:29.152118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.103276 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 17:34:29.649746 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.649718 2578 apiserver.go:52] "Watching apiserver" Jul 03 17:34:29.658999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.658004 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 17:34:29.658999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.658520 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-99dht","kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c","openshift-dns/node-resolver-xp8nd","openshift-image-registry/node-ca-92dhm","openshift-multus/multus-additional-cni-plugins-lzqst","openshift-multus/network-metrics-daemon-2ng2c","openshift-network-diagnostics/network-check-target-6jg9x","openshift-network-operator/iptables-alerter-84w4m","kube-system/global-pull-secret-syncer-trmsv","kube-system/konnectivity-agent-msfb7","openshift-cluster-node-tuning-operator/tuned-4pkdv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal","openshift-multus/multus-kd72l"] Jul 03 17:34:29.660711 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.660370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.660711 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.660473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:29.662011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.661611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.663755 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.663725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.664401 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.664380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xxtzv\"" Jul 03 17:34:29.664789 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.664588 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 17:34:29.664789 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.664755 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 17:34:29.666117 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.666093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.666683 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.666665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 17:34:29.666901 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.666877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.666993 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.666912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.667240 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.667217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-px6wv\"" Jul 03 17:34:29.668925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.668903 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.669142 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.669124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tf9hv\"" Jul 03 17:34:29.669387 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.669367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.673082 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.672419 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 17:34:29.673813 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.673763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.679290 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.676638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.681686 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.680885 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.681686 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.681170 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 17:34:29.681686 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.681407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwglw\"" Jul 03 17:34:29.681686 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.681571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.682006 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.681950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 17:34:29.682212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.682194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-km44j\"" Jul 03 17:34:29.682553 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.682531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.682753 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.682737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.684031 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.684011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:29.684651 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.684163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:29.686045 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.686022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.686135 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.686113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687200 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687256 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687351 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687535 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.687630 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.687581 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.688211 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.688194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.688416 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.688356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wjlms\"" Jul 03 17:34:29.689111 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.688659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rg26\"" Jul 03 17:34:29.689111 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.688894 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.689289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83d5f30c-d4a4-47c2-a421-ae29a2b05298-konnectivity-ca\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.689289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a3cd672-8715-4970-b492-8aa397244b58-host\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.689289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9w2\" (UniqueName: \"kubernetes.io/projected/40c804ed-f896-42a5-9e6f-46794b04ba62-kube-api-access-lc9w2\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.689289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fa9c97-5e51-43a6-a391-e452a7270939-hosts-file\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.689289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83d5f30c-d4a4-47c2-a421-ae29a2b05298-agent-certs\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-sys-fs\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-socket-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fa9c97-5e51-43a6-a391-e452a7270939-tmp-dir\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a3cd672-8715-4970-b492-8aa397244b58-serviceca\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxhn\" (UniqueName: \"kubernetes.io/projected/8a3cd672-8715-4970-b492-8aa397244b58-kube-api-access-mrxhn\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.689567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.690004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-registration-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.690004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-device-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.690004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggs6p\" (UniqueName: \"kubernetes.io/projected/81fa9c97-5e51-43a6-a391-e452a7270939-kube-api-access-ggs6p\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.690004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.689701 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzc4\" (UniqueName: \"kubernetes.io/projected/d6d41ac2-bf75-46e8-b376-57d526a52d19-kube-api-access-jzzc4\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.693591 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.693570 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.694180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.694158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 17:34:29.694272 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.694197 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xxz2k\"" Jul 03 17:34:29.694366 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.694318 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l4r74\"" Jul 03 17:34:29.694421 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.694367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 17:34:29.695718 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.695698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 17:34:29.695917 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.695896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.696005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.695943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 17:34:29.696005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.695997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 17:34:29.696232 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.695739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 17:34:29.696232 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.696187 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 17:34:29.709449 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.709424 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mlkjv" Jul 03 17:34:29.719247 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.719091 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mlkjv" Jul 03 17:34:29.774191 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.774092 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 17:34:29.789983 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.789949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-socket-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.789995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fa9c97-5e51-43a6-a391-e452a7270939-tmp-dir\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-systemd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcmd\" (UniqueName: \"kubernetes.io/projected/302d619f-caca-4572-9e45-2f8aae87ae63-kube-api-access-ztcmd\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.790161 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-run\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.790551 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fa9c97-5e51-43a6-a391-e452a7270939-hosts-file\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.790551 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.790296 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:29.790551 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.790397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:30.290365725 +0000 UTC m=+2.984462903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:29.790551 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-socket-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.790551 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-slash\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-ovn\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-config\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-script-lib\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-etc-selinux\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kwkf\" (UniqueName: \"kubernetes.io/projected/67e8600c-85d3-4436-bda9-10b6bb95df79-kube-api-access-5kwkf\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysconfig\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-kubelet\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-sys-fs\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.790855 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-env-overrides\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-tmp\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fa9c97-5e51-43a6-a391-e452a7270939-tmp-dir\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-system-cni-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790980 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-sys-fs\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.790983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4976d\" (UniqueName: \"kubernetes.io/projected/af800938-5641-450a-a2ef-968ef7b2da35-kube-api-access-4976d\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fa9c97-5e51-43a6-a391-e452a7270939-hosts-file\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-os-release\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-conf-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-conf\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj69z\" (UniqueName: \"kubernetes.io/projected/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-kube-api-access-tj69z\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-k8s-cni-cncf-io\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.791321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-registration-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-device-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggs6p\" (UniqueName: \"kubernetes.io/projected/81fa9c97-5e51-43a6-a391-e452a7270939-kube-api-access-ggs6p\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-host\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-registration-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-cnibin\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-device-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-system-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a3cd672-8715-4970-b492-8aa397244b58-host\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a3cd672-8715-4970-b492-8aa397244b58-host\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9w2\" (UniqueName: \"kubernetes.io/projected/40c804ed-f896-42a5-9e6f-46794b04ba62-kube-api-access-lc9w2\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-systemd-units\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-node-log\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-netns\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-etc-kubernetes\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d619f-caca-4572-9e45-2f8aae87ae63-iptables-alerter-script\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-log-socket\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.792214 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-tuned\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-bin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.791976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-multus-certs\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxhn\" (UniqueName: \"kubernetes.io/projected/8a3cd672-8715-4970-b492-8aa397244b58-kube-api-access-mrxhn\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40c804ed-f896-42a5-9e6f-46794b04ba62-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-netd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-multus-daemon-config\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzc4\" (UniqueName: \"kubernetes.io/projected/d6d41ac2-bf75-46e8-b376-57d526a52d19-kube-api-access-jzzc4\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-kubelet\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-kubernetes\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-systemd\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-netns\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.793234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-os-release\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d619f-caca-4572-9e45-2f8aae87ae63-host-slash\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-var-lib-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-etc-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-bin\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-var-lib-kubelet\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a3cd672-8715-4970-b492-8aa397244b58-serviceca\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-sys\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-hostroot\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-kubelet-config\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-dbus\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-lib-modules\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.792987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-multus\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83d5f30c-d4a4-47c2-a421-ae29a2b05298-agent-certs\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-cnibin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-socket-dir-parent\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjs4\" (UniqueName: \"kubernetes.io/projected/bc783b3a-aa43-4e34-a521-70e25162351d-kube-api-access-hsjs4\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a3cd672-8715-4970-b492-8aa397244b58-serviceca\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67e8600c-85d3-4436-bda9-10b6bb95df79-ovn-node-metrics-cert\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-modprobe-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-cni-binary-copy\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83d5f30c-d4a4-47c2-a421-ae29a2b05298-konnectivity-ca\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793530 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 17:34:29.794900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.793981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83d5f30c-d4a4-47c2-a421-ae29a2b05298-konnectivity-ca\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.798314 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.798256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83d5f30c-d4a4-47c2-a421-ae29a2b05298-agent-certs\") pod \"konnectivity-agent-msfb7\" (UID: \"83d5f30c-d4a4-47c2-a421-ae29a2b05298\") " pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.802177 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.801870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggs6p\" (UniqueName: \"kubernetes.io/projected/81fa9c97-5e51-43a6-a391-e452a7270939-kube-api-access-ggs6p\") pod \"node-resolver-xp8nd\" (UID: \"81fa9c97-5e51-43a6-a391-e452a7270939\") " pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:29.802177 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.802134 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9w2\" (UniqueName: \"kubernetes.io/projected/40c804ed-f896-42a5-9e6f-46794b04ba62-kube-api-access-lc9w2\") pod \"aws-ebs-csi-driver-node-mzn2c\" (UID: \"40c804ed-f896-42a5-9e6f-46794b04ba62\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.805650 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.805603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxhn\" (UniqueName: \"kubernetes.io/projected/8a3cd672-8715-4970-b492-8aa397244b58-kube-api-access-mrxhn\") pod \"node-ca-92dhm\" (UID: \"8a3cd672-8715-4970-b492-8aa397244b58\") " pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:29.807783 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.807741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzc4\" (UniqueName: \"kubernetes.io/projected/d6d41ac2-bf75-46e8-b376-57d526a52d19-kube-api-access-jzzc4\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893517 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-netd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-multus-daemon-config\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-kubelet\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-kubernetes\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-systemd\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-netns\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-os-release\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d619f-caca-4572-9e45-2f8aae87ae63-host-slash\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.893973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-var-lib-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-etc-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-bin\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-var-lib-kubelet\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.894163 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-sys\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-hostroot\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-kubelet-config\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-dbus\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-lib-modules\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-multus\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-cnibin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-socket-dir-parent\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjs4\" (UniqueName: \"kubernetes.io/projected/bc783b3a-aa43-4e34-a521-70e25162351d-kube-api-access-hsjs4\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67e8600c-85d3-4436-bda9-10b6bb95df79-ovn-node-metrics-cert\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-modprobe-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-cni-binary-copy\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-multus-daemon-config\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-systemd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.895220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-netd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.894733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-sys\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-kubelet\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcmd\" (UniqueName: \"kubernetes.io/projected/302d619f-caca-4572-9e45-2f8aae87ae63-kube-api-access-ztcmd\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-run\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-slash\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-ovn\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-config\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-script-lib\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kwkf\" (UniqueName: \"kubernetes.io/projected/67e8600c-85d3-4436-bda9-10b6bb95df79-kube-api-access-5kwkf\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysconfig\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-kubelet\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-env-overrides\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-tmp\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-system-cni-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.896097 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4976d\" (UniqueName: \"kubernetes.io/projected/af800938-5641-450a-a2ef-968ef7b2da35-kube-api-access-4976d\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-os-release\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-conf-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-conf\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj69z\" (UniqueName: \"kubernetes.io/projected/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-kube-api-access-tj69z\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-k8s-cni-cncf-io\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-host\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-kubelet\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-cnibin\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-system-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-kubernetes\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-systemd-units\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-node-log\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-netns\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-etc-kubernetes\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.895986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d619f-caca-4572-9e45-2f8aae87ae63-iptables-alerter-script\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-log-socket\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.896999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-tuned\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-bin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-multus-certs\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-run\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-cnibin\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysconfig\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-system-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.896790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-env-overrides\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-netns\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-systemd-units\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-node-log\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-netns\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897403 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-etc-kubernetes\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.897980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.897969 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d619f-caca-4572-9e45-2f8aae87ae63-iptables-alerter-script\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.898736 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.898047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-log-socket\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.898736 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.898118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-system-cni-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.898736 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.898186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.898736 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.898632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-cni-binary-copy\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.898925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.898897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-sysctl-conf\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-var-lib-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-os-release\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-conf-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-ovn\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-bin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-multus-certs\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-dbus\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-slash\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-etc-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-cni-dir\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-cni-bin\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899491 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-lib-modules\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-cnibin\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-var-lib-kubelet\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-var-lib-cni-multus\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af800938-5641-450a-a2ef-968ef7b2da35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.899963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-modprobe-d\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.900772 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.900044 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.900106 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:30.400088089 +0000 UTC m=+3.094185283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-script-lib\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-host-run-k8s-cni-cncf-io\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-hostroot\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-host\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-run-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af800938-5641-450a-a2ef-968ef7b2da35-os-release\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d9b3968-372d-46d4-adbf-365b888c1429-kubelet-config\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d619f-caca-4572-9e45-2f8aae87ae63-host-slash\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900358 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc783b3a-aa43-4e34-a521-70e25162351d-multus-socket-dir-parent\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc783b3a-aa43-4e34-a521-70e25162351d-cni-binary-copy\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-systemd\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-systemd\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.900702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67e8600c-85d3-4436-bda9-10b6bb95df79-run-openvswitch\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.901656 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.901019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67e8600c-85d3-4436-bda9-10b6bb95df79-ovnkube-config\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.902440 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.901228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-tmp\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.902440 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.901770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-etc-tuned\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.902621 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.902598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67e8600c-85d3-4436-bda9-10b6bb95df79-ovn-node-metrics-cert\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.916903 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.916845 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:29.916903 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.916870 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:29.916903 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.916888 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:29.917158 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:29.916964 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:34:30.41694971 +0000 UTC m=+3.111046889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:29.927139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.926976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4976d\" (UniqueName: \"kubernetes.io/projected/af800938-5641-450a-a2ef-968ef7b2da35-kube-api-access-4976d\") pod \"multus-additional-cni-plugins-lzqst\" (UID: \"af800938-5641-450a-a2ef-968ef7b2da35\") " pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:29.927139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.927007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj69z\" (UniqueName: \"kubernetes.io/projected/fc6e7c1f-d9cb-4a75-ba14-46cc6729317a-kube-api-access-tj69z\") pod \"tuned-4pkdv\" (UID: \"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:29.927139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.927047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kwkf\" (UniqueName: \"kubernetes.io/projected/67e8600c-85d3-4436-bda9-10b6bb95df79-kube-api-access-5kwkf\") pod \"ovnkube-node-99dht\" (UID: \"67e8600c-85d3-4436-bda9-10b6bb95df79\") " pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:29.927405 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.927137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjs4\" (UniqueName: \"kubernetes.io/projected/bc783b3a-aa43-4e34-a521-70e25162351d-kube-api-access-hsjs4\") pod \"multus-kd72l\" (UID: \"bc783b3a-aa43-4e34-a521-70e25162351d\") " pod="openshift-multus/multus-kd72l" Jul 03 17:34:29.927405 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.927189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcmd\" (UniqueName: \"kubernetes.io/projected/302d619f-caca-4572-9e45-2f8aae87ae63-kube-api-access-ztcmd\") pod \"iptables-alerter-84w4m\" (UID: \"302d619f-caca-4572-9e45-2f8aae87ae63\") " pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:29.936687 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.936641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"19c650d7b90f9cfab0129bb7ed79b977","Type":"ContainerStarted","Data":"c522fc8e31a3c6c2be26707cda49880751d592dae139fd2d3d594f2e05d63fe9"} Jul 03 17:34:29.937928 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.937904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"a0854266c70379aa8ce321ab152e516e","Type":"ContainerStarted","Data":"64999e101bcb3791afa313d09b36f419a79075e3b65ffbcb6d8e75ee0a508955"} Jul 03 17:34:29.980992 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.980949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:29.990729 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:29.990703 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" Jul 03 17:34:29.993091 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:29.993064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d5f30c_d4a4_47c2_a421_ae29a2b05298.slice/crio-9d7b385af6ba9a160b385947fced1cb6b584f325e0487afe0ece21cd5de96b90 WatchSource:0}: Error finding container 9d7b385af6ba9a160b385947fced1cb6b584f325e0487afe0ece21cd5de96b90: Status 404 returned error can't find the container with id 9d7b385af6ba9a160b385947fced1cb6b584f325e0487afe0ece21cd5de96b90 Jul 03 17:34:29.999750 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:29.999724 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c804ed_f896_42a5_9e6f_46794b04ba62.slice/crio-2971c10787a8a393564a5529755587298e921ab11a8d2fad2b1ea55e42f57bda WatchSource:0}: Error finding container 2971c10787a8a393564a5529755587298e921ab11a8d2fad2b1ea55e42f57bda: Status 404 returned error can't find the container with id 2971c10787a8a393564a5529755587298e921ab11a8d2fad2b1ea55e42f57bda Jul 03 17:34:30.001383 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.001321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xp8nd" Jul 03 17:34:30.009212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.009077 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-92dhm" Jul 03 17:34:30.017178 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.017156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lzqst" Jul 03 17:34:30.026353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.026327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84w4m" Jul 03 17:34:30.034644 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.034618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kd72l" Jul 03 17:34:30.042156 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.042136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:30.050170 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.050151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" Jul 03 17:34:30.299284 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.299194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:30.299465 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.299408 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:30.299547 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.299494 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:31.299471771 +0000 UTC m=+3.993568969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:30.400293 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.400250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:30.400483 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.400421 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:30.400549 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.400502 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:31.400485787 +0000 UTC m=+4.094582962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:30.501224 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.501185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:30.501413 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.501370 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:30.501413 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.501391 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:30.501413 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.501405 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:30.501534 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.501501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:34:31.501480277 +0000 UTC m=+4.195577465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:30.721277 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.721127 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 17:29:30 +0000 UTC" deadline="2028-02-08 21:18:39.085897962 +0000 UTC" Jul 03 17:34:30.721277 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.721227 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14043h44m8.364680433s" Jul 03 17:34:30.932128 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.932090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:30.932315 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.932255 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:30.932385 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.932331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:30.932474 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.932421 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:30.932531 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.932506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:30.932604 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:30.932583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:30.940912 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.940882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msfb7" event={"ID":"83d5f30c-d4a4-47c2-a421-ae29a2b05298","Type":"ContainerStarted","Data":"9d7b385af6ba9a160b385947fced1cb6b584f325e0487afe0ece21cd5de96b90"} Jul 03 17:34:30.942270 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:30.942239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" event={"ID":"40c804ed-f896-42a5-9e6f-46794b04ba62","Type":"ContainerStarted","Data":"2971c10787a8a393564a5529755587298e921ab11a8d2fad2b1ea55e42f57bda"} Jul 03 17:34:31.179959 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.179922 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fa9c97_5e51_43a6_a391_e452a7270939.slice/crio-27a84e21706db71bc7f9a5563792da1e81ee406c0177ecd12adb6cd228977513 WatchSource:0}: Error finding container 27a84e21706db71bc7f9a5563792da1e81ee406c0177ecd12adb6cd228977513: Status 404 returned error can't find the container with id 27a84e21706db71bc7f9a5563792da1e81ee406c0177ecd12adb6cd228977513 Jul 03 17:34:31.307814 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.307775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:31.308011 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.307956 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:31.308077 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.308040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.30801895 +0000 UTC m=+6.002116150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:31.409036 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.408994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:31.409221 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.409178 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:31.409301 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.409262 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.409241479 +0000 UTC m=+6.103338676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:31.510402 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.510290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:31.510582 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.510515 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:31.510582 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.510539 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:31.510582 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.510550 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:31.510752 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:31.510612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:34:33.510595321 +0000 UTC m=+6.204692501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:31.617818 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.617781 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc783b3a_aa43_4e34_a521_70e25162351d.slice/crio-2a8ae020b80f0f47304c171b4efd33b7eb7a9196daca47fc96fad65dc7b1e485 WatchSource:0}: Error finding container 2a8ae020b80f0f47304c171b4efd33b7eb7a9196daca47fc96fad65dc7b1e485: Status 404 returned error can't find the container with id 2a8ae020b80f0f47304c171b4efd33b7eb7a9196daca47fc96fad65dc7b1e485 Jul 03 17:34:31.620931 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.620812 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302d619f_caca_4572_9e45_2f8aae87ae63.slice/crio-64dbc41e3ffe32c2c0658f40328b3146adbf8e493295e2f2d535d5a3d965c63d WatchSource:0}: Error finding container 64dbc41e3ffe32c2c0658f40328b3146adbf8e493295e2f2d535d5a3d965c63d: Status 404 returned error can't find the container with id 64dbc41e3ffe32c2c0658f40328b3146adbf8e493295e2f2d535d5a3d965c63d Jul 03 17:34:31.621691 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.621623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3cd672_8715_4970_b492_8aa397244b58.slice/crio-7c3f220a07192f9be0d0fd82ac673a42e13affcae3a0eb0da689bea5541cb22f WatchSource:0}: Error finding container 7c3f220a07192f9be0d0fd82ac673a42e13affcae3a0eb0da689bea5541cb22f: Status 404 returned error can't find the container with id 7c3f220a07192f9be0d0fd82ac673a42e13affcae3a0eb0da689bea5541cb22f Jul 03 17:34:31.623288 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.623257 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e8600c_85d3_4436_bda9_10b6bb95df79.slice/crio-e2d90d7da37b07c1773f19fed5ba7f43e90bc249db1cb7a5bb77061bae2a5b62 WatchSource:0}: Error finding container e2d90d7da37b07c1773f19fed5ba7f43e90bc249db1cb7a5bb77061bae2a5b62: Status 404 returned error can't find the container with id e2d90d7da37b07c1773f19fed5ba7f43e90bc249db1cb7a5bb77061bae2a5b62 Jul 03 17:34:31.638963 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:34:31.638934 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6e7c1f_d9cb_4a75_ba14_46cc6729317a.slice/crio-d6ddd91db7bfbd0d2142c46c4962b75842b17702f5b04bffab2a064de9fb865b WatchSource:0}: Error finding container d6ddd91db7bfbd0d2142c46c4962b75842b17702f5b04bffab2a064de9fb865b: Status 404 returned error can't find the container with id d6ddd91db7bfbd0d2142c46c4962b75842b17702f5b04bffab2a064de9fb865b Jul 03 17:34:31.722396 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.722162 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 17:29:30 +0000 UTC" deadline="2028-03-05 09:24:14.487816098 +0000 UTC" Jul 03 17:34:31.722396 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.722394 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14655h49m42.765427521s" Jul 03 17:34:31.948177 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.948049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"a0854266c70379aa8ce321ab152e516e","Type":"ContainerStarted","Data":"1f56d4f518cbdbddb644fd32862a0d736117de4d64c3f2d6d8f8dbdd2dd67866"} Jul 03 17:34:31.950912 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.950877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" event={"ID":"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a","Type":"ContainerStarted","Data":"d6ddd91db7bfbd0d2142c46c4962b75842b17702f5b04bffab2a064de9fb865b"} Jul 03 17:34:31.953532 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.953504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerStarted","Data":"10bf2552760606d5bb851aa1fc0b0a3337805749d62a09a2ea61193c2124e597"} Jul 03 17:34:31.955424 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.955378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"e2d90d7da37b07c1773f19fed5ba7f43e90bc249db1cb7a5bb77061bae2a5b62"} Jul 03 17:34:31.956952 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.956925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92dhm" event={"ID":"8a3cd672-8715-4970-b492-8aa397244b58","Type":"ContainerStarted","Data":"7c3f220a07192f9be0d0fd82ac673a42e13affcae3a0eb0da689bea5541cb22f"} Jul 03 17:34:31.958749 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.958725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84w4m" event={"ID":"302d619f-caca-4572-9e45-2f8aae87ae63","Type":"ContainerStarted","Data":"64dbc41e3ffe32c2c0658f40328b3146adbf8e493295e2f2d535d5a3d965c63d"} Jul 03 17:34:31.960666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.960639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kd72l" event={"ID":"bc783b3a-aa43-4e34-a521-70e25162351d","Type":"ContainerStarted","Data":"2a8ae020b80f0f47304c171b4efd33b7eb7a9196daca47fc96fad65dc7b1e485"} Jul 03 17:34:31.962373 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.962325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xp8nd" event={"ID":"81fa9c97-5e51-43a6-a391-e452a7270939","Type":"ContainerStarted","Data":"27a84e21706db71bc7f9a5563792da1e81ee406c0177ecd12adb6cd228977513"} Jul 03 17:34:31.967924 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:31.967077 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" podStartSLOduration=2.967059108 podStartE2EDuration="2.967059108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:31.966793759 +0000 UTC m=+4.660890960" watchObservedRunningTime="2026-07-03 17:34:31.967059108 +0000 UTC m=+4.661156309" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.932434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.932488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.932484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:32.932615 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:32.933094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:32.933238 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:32.933196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:32.970479 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.969528 2578 generic.go:356] "Generic (PLEG): container finished" podID="19c650d7b90f9cfab0129bb7ed79b977" containerID="d7767aadb1b6baac0440e6d51ca5543b07063420e27167e94db2decfd6ec4a36" exitCode=0 Jul 03 17:34:32.970479 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.969629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"19c650d7b90f9cfab0129bb7ed79b977","Type":"ContainerDied","Data":"d7767aadb1b6baac0440e6d51ca5543b07063420e27167e94db2decfd6ec4a36"} Jul 03 17:34:32.975083 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:32.974059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-msfb7" event={"ID":"83d5f30c-d4a4-47c2-a421-ae29a2b05298","Type":"ContainerStarted","Data":"169a83119a01aaf0726d45a8a81095c0e8cb22b938b1e5d1c25e36e5f7e5704f"} Jul 03 17:34:33.009128 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:33.009063 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-msfb7" podStartSLOduration=3.356406204 podStartE2EDuration="5.009041758s" totalImagesPullingTime="1.652635554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:33.008871374 +0000 UTC m=+5.702968574" watchObservedRunningTime="2026-07-03 17:34:33.009041758 +0000 UTC m=+5.703138960" Jul 03 17:34:33.326638 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:33.326536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:33.326815 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.326725 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:33.326815 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.326811 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:37.326788253 +0000 UTC m=+10.020885444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:33.427593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:33.427546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:33.427806 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.427725 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:33.427806 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.427799 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:37.42777879 +0000 UTC m=+10.121875972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:33.528556 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:33.528515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:33.528800 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.528764 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:33.528800 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.528790 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:33.528800 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.528804 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:33.529017 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:33.528871 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:34:37.5288522 +0000 UTC m=+10.222949401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:34.231832 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.231731 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:34.232327 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.232216 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:34.932534 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.932497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:34.933554 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:34.932767 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:34.933554 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.933242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:34.933554 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:34.933345 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:34.933554 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.933400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:34.933554 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:34.933495 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:34.982866 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.982828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xp8nd" event={"ID":"81fa9c97-5e51-43a6-a391-e452a7270939","Type":"ContainerStarted","Data":"ed0d0c175ae3ea43d8d10f1e216f084bcfdeb0881ddae9d44094dd9baa563aa2"} Jul 03 17:34:34.986664 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:34.986630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"19c650d7b90f9cfab0129bb7ed79b977","Type":"ContainerStarted","Data":"96d76c2ec6e68552e78e7a63454a003c9ae7028723c71cfbf717006574458500"} Jul 03 17:34:35.001314 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:35.000996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" event={"ID":"40c804ed-f896-42a5-9e6f-46794b04ba62","Type":"ContainerStarted","Data":"9d568c05f94ba8a77ac54665b5364fced3ac49922561b93a78de513735b2f252"} Jul 03 17:34:35.037708 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:35.037643 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xp8nd" podStartSLOduration=4.127170964 podStartE2EDuration="7.037618198s" totalImagesPullingTime="2.910447234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:35.01437478 +0000 UTC m=+7.708471981" watchObservedRunningTime="2026-07-03 17:34:35.037618198 +0000 UTC m=+7.731715400" Jul 03 17:34:36.012400 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.012322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84w4m" event={"ID":"302d619f-caca-4572-9e45-2f8aae87ae63","Type":"ContainerStarted","Data":"e60ea1d1cf485af14c12ab42c308082d9513cc432153765e40c6caa8a0e0d6f3"} Jul 03 17:34:36.012910 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.012453 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 03 17:34:36.052201 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.051615 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" podStartSLOduration=7.051592146 podStartE2EDuration="7.051592146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:35.038720759 +0000 UTC m=+7.732817960" watchObservedRunningTime="2026-07-03 17:34:36.051592146 +0000 UTC m=+8.745689346" Jul 03 17:34:36.932387 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.932334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:36.932564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.932341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:36.932564 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:36.932494 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:36.932564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:36.932506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:36.932726 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:36.932582 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:36.932726 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:36.932709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:37.364500 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:37.364465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:37.364974 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.364619 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:37.364974 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.364689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:45.364671049 +0000 UTC m=+18.058768238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:37.465646 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:37.465604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:37.465812 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.465771 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:37.465865 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.465851 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:34:45.465827592 +0000 UTC m=+18.159924784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:37.566918 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:37.566871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:37.567093 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.567064 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:37.567154 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.567097 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:37.567154 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.567111 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:37.567238 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:37.567181 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:34:45.567159756 +0000 UTC m=+18.261256948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:38.932868 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:38.932568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:38.932868 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:38.932650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:38.932868 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:38.932716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:38.932868 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:38.932776 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:38.932868 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:38.932859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:38.933579 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:38.932939 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:40.932697 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:40.932450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:40.933749 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:40.932821 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:40.933749 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:40.932535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:40.933749 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:40.932941 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:40.933749 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:40.932503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:40.933749 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:40.933018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:41.024619 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:41.024549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerStarted","Data":"6faed174041a3407ad04fd632ada7f9fd36f8bdbff43348c24711f6cd35acca4"} Jul 03 17:34:41.027048 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:41.026992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-92dhm" event={"ID":"8a3cd672-8715-4970-b492-8aa397244b58","Type":"ContainerStarted","Data":"4b5b525b6f4bd30ee345da9056dd3efb80df4ce25b6bb93e8a65509807d0beb1"} Jul 03 17:34:41.060422 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:41.060339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84w4m" podStartSLOduration=10.579571404 podStartE2EDuration="13.060321216s" totalImagesPullingTime="2.480749812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:36.052011102 +0000 UTC m=+8.746108302" watchObservedRunningTime="2026-07-03 17:34:41.060321216 +0000 UTC m=+13.754418411" Jul 03 17:34:41.086829 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:41.086767 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-92dhm" podStartSLOduration=4.035351732 podStartE2EDuration="13.086746668s" totalImagesPullingTime="9.051394936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:41.086470001 +0000 UTC m=+13.780567198" watchObservedRunningTime="2026-07-03 17:34:41.086746668 +0000 UTC m=+13.780843866" Jul 03 17:34:42.031279 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.030998 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" event={"ID":"fc6e7c1f-d9cb-4a75-ba14-46cc6729317a","Type":"ContainerStarted","Data":"1f4819866e725de433d3d8bc10bdd7de7d631a211df3384ad048596b950befa8"} Jul 03 17:34:42.032542 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.032518 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="6faed174041a3407ad04fd632ada7f9fd36f8bdbff43348c24711f6cd35acca4" exitCode=0 Jul 03 17:34:42.032666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.032599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"6faed174041a3407ad04fd632ada7f9fd36f8bdbff43348c24711f6cd35acca4"} Jul 03 17:34:42.052894 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.052844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4pkdv" podStartSLOduration=4.562144183 podStartE2EDuration="14.052828237s" totalImagesPullingTime="9.490684054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:42.052217093 +0000 UTC m=+14.746314289" watchObservedRunningTime="2026-07-03 17:34:42.052828237 +0000 UTC m=+14.746925430" Jul 03 17:34:42.932530 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.932491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:42.932712 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.932494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:42.932712 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:42.932642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:42.932712 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:42.932494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:42.932869 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:42.932703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:42.932869 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:42.932785 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:44.932782 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:44.932748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:44.932782 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:44.932774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:44.932782 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:44.932740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:44.933405 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:44.932885 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:44.933405 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:44.932952 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:44.933405 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:44.933039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:45.430117 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:45.430078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:45.430385 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.430343 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:45.430571 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.430523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:01.430496746 +0000 UTC m=+34.124593930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:34:45.531213 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:45.531175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:45.531425 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.531351 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:45.531501 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.531452 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:01.531424495 +0000 UTC m=+34.225521689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:34:45.632063 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:45.632021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:45.632284 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.632243 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:34:45.632284 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.632275 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:34:45.632284 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.632290 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:45.632550 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:45.632362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:35:01.632342854 +0000 UTC m=+34.326440055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:34:46.932678 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:46.932637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:46.932678 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:46.932677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:46.933210 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:46.932682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:46.933210 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:46.932774 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:46.933210 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:46.932918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:46.933210 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:46.933047 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:48.932338 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:48.932293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:48.932822 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:48.932303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:48.932822 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:48.932314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:48.932822 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:48.932460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:48.932822 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:48.932558 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:48.932822 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:48.932650 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:50.932772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:50.932730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:50.932772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:50.932762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:50.933319 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:50.932759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:50.933319 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:50.932896 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:50.933319 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:50.933024 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:50.933319 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:50.933092 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:51.486424 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:51.486393 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 17:34:51.775352 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:51.775069 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T17:34:51.486417939Z","UUID":"44cf283d-5ed5-43dc-b32d-83a802d4ba09","Handler":null,"Name":"","Endpoint":""} Jul 03 17:34:51.776443 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:51.776424 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 17:34:51.776522 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:51.776467 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 17:34:52.055082 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.055056 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="a3a8770a23cd29f3be48fa84ed6905a634850e36f559a19bb2d63349767e12ce" exitCode=0 Jul 03 17:34:52.055514 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.055127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"a3a8770a23cd29f3be48fa84ed6905a634850e36f559a19bb2d63349767e12ce"} Jul 03 17:34:52.057655 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.057634 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:34:52.058047 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.057998 2578 generic.go:356] "Generic (PLEG): container finished" podID="67e8600c-85d3-4436-bda9-10b6bb95df79" containerID="9baebdf455af22d877c9988494d3b5e2e37c9059b6ed321d2e646562ea28dba9" exitCode=1 Jul 03 17:34:52.058132 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.058072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"88e393ee46b9e2edd44db2d1d128a04c07592b9f732d56327101cc2d1c1dc758"} Jul 03 17:34:52.058194 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.058141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"c92646e79e046ea60c5f7ee810148cecc1e4f997dbf6e3c411d5604f1a558665"} Jul 03 17:34:52.058194 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.058185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"7deb937beebec317796c9ed1751cf8095687f1bf9273c4e27c244a76231cc3b6"} Jul 03 17:34:52.058293 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.058224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerDied","Data":"9baebdf455af22d877c9988494d3b5e2e37c9059b6ed321d2e646562ea28dba9"} Jul 03 17:34:52.058293 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.058257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"a9ab428e27d887ec71f783cae767f303d5c351f01aaf4b7b22a2041e414191f2"} Jul 03 17:34:52.059413 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.059392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kd72l" event={"ID":"bc783b3a-aa43-4e34-a521-70e25162351d","Type":"ContainerStarted","Data":"495ab338174e5578981cd341b213fa5d7d7f9ab10e4490181efe6330d9c05a0b"} Jul 03 17:34:52.061027 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.061008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" event={"ID":"40c804ed-f896-42a5-9e6f-46794b04ba62","Type":"ContainerStarted","Data":"ae1c6c842f1753335584640d6d0558551bed94e5b7823dbb67382da2f3e3ceb5"} Jul 03 17:34:52.147287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.147185 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kd72l" podStartSLOduration=4.464864492 podStartE2EDuration="24.147163466s" totalImagesPullingTime="19.682298974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:52.146869724 +0000 UTC m=+24.840966933" watchObservedRunningTime="2026-07-03 17:34:52.147163466 +0000 UTC m=+24.841260666" Jul 03 17:34:52.932962 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.932934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:52.933085 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.933039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:52.933085 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:52.933046 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:52.933085 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:52.933069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:52.933202 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:52.933152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:52.933244 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:52.933202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:53.068906 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:53.068830 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:34:53.069565 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:53.069231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"ad1160a6dd16e39aefc58ce66bc947b264992101b858eb60834d306c2d6f4418"} Jul 03 17:34:53.071221 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:53.071193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" event={"ID":"40c804ed-f896-42a5-9e6f-46794b04ba62","Type":"ContainerStarted","Data":"a1aada5467ed5ba22df051bf68a83d880f0180e1aedbb18aac19fbcbd23e6f91"} Jul 03 17:34:53.091065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:53.091019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mzn2c" podStartSLOduration=2.928881204 podStartE2EDuration="25.091003024s" totalImagesPullingTime="22.16212182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:53.090067954 +0000 UTC m=+25.784165149" watchObservedRunningTime="2026-07-03 17:34:53.091003024 +0000 UTC m=+25.785100221" Jul 03 17:34:54.074921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:54.074883 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="d41ed1691957f4ef1a01f00c698cd4dbec5d207259465120a8ef3111765ad493" exitCode=0 Jul 03 17:34:54.075510 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:54.074961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"d41ed1691957f4ef1a01f00c698cd4dbec5d207259465120a8ef3111765ad493"} Jul 03 17:34:54.932326 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:54.932294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:54.932564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:54.932294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:54.932564 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:54.932413 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:54.932564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:54.932294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:54.932564 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:54.932476 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:54.932697 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:54.932564 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:55.079957 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:55.079932 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:34:55.080355 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:55.080271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"70a99082f0005952fddd5efac0deafc62666fe99d2ce60d1fe6e731cfbee570d"} Jul 03 17:34:56.089706 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:56.089673 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="37a6d227b1818e5d5c34246f9b81a9f27005aefab4f72d553db476194ac37a5b" exitCode=0 Jul 03 17:34:56.090069 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:56.089721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"37a6d227b1818e5d5c34246f9b81a9f27005aefab4f72d553db476194ac37a5b"} Jul 03 17:34:56.932602 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:56.932396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:56.932799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:56.932402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:56.932799 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:56.932693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:34:56.932799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:56.932406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:56.932799 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:56.932782 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:56.932979 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:56.932827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:57.096334 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.096302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:34:57.096888 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.096710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"0d614539a95339a69769b38c9d5c2300b07bfe6c05d6d2dababb1ca31c6a02bb"} Jul 03 17:34:57.097025 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.097004 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:57.097098 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.097079 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:57.097205 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.097184 2578 scope.go:117] "RemoveContainer" containerID="9baebdf455af22d877c9988494d3b5e2e37c9059b6ed321d2e646562ea28dba9" Jul 03 17:34:57.115954 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:57.115929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:58.103831 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.103800 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:34:58.104264 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.104222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" event={"ID":"67e8600c-85d3-4436-bda9-10b6bb95df79","Type":"ContainerStarted","Data":"3837b58ab3b102e257c8bda95bd8bfc76d8d7c28408d9ec48974893c849d30a5"} Jul 03 17:34:58.104527 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.104509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:58.121587 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.121488 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:34:58.139320 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.139253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" podStartSLOduration=10.474289989 podStartE2EDuration="30.139233518s" totalImagesPullingTime="19.664943529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:34:58.138834432 +0000 UTC m=+30.832931630" watchObservedRunningTime="2026-07-03 17:34:58.139233518 +0000 UTC m=+30.833330715" Jul 03 17:34:58.678264 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.678228 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:58.678499 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.678401 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 03 17:34:58.678854 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.678827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-msfb7" Jul 03 17:34:58.773679 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.773649 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jg9x"] Jul 03 17:34:58.773860 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.773765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:34:58.773860 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:58.773846 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:34:58.776806 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.776781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ng2c"] Jul 03 17:34:58.776925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.776889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:34:58.777003 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:58.776979 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:34:58.792327 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.792298 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-trmsv"] Jul 03 17:34:58.792513 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:34:58.792433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:34:58.792572 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:34:58.792533 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:35:00.932141 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:00.931901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:00.932569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:00.931951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:00.932569 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:00.932163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:35:00.932569 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:00.932265 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:35:00.932569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:00.931952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:00.932569 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:00.932363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:35:01.113967 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:01.113933 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="1d9cdf034afe1e68921c2d9e2e4da36180c30a5491372dde5ac704745143285d" exitCode=0 Jul 03 17:35:01.114155 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:01.113983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"1d9cdf034afe1e68921c2d9e2e4da36180c30a5491372dde5ac704745143285d"} Jul 03 17:35:01.449770 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:01.449742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:01.449924 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.449904 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:35:01.449980 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.449970 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:33.449952786 +0000 UTC m=+66.144049984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 17:35:01.550612 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:01.550578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:01.550756 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.550722 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 17:35:01.550812 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.550784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret podName:2d9b3968-372d-46d4-adbf-365b888c1429 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:33.550766294 +0000 UTC m=+66.244863471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret") pod "global-pull-secret-syncer-trmsv" (UID: "2d9b3968-372d-46d4-adbf-365b888c1429") : object "kube-system"/"original-pull-secret" not registered Jul 03 17:35:01.650962 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:01.650926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:01.651103 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.651043 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 17:35:01.651103 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.651058 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 17:35:01.651103 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.651067 2578 projected.go:196] Error preparing data for projected volume kube-api-access-s4d6t for pod openshift-network-diagnostics/network-check-target-6jg9x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:35:01.651206 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:01.651113 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t podName:da70a016-6966-4648-a644-261f0b8dffaa nodeName:}" failed. No retries permitted until 2026-07-03 17:35:33.651101352 +0000 UTC m=+66.345198526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4d6t" (UniqueName: "kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t") pod "network-check-target-6jg9x" (UID: "da70a016-6966-4648-a644-261f0b8dffaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 17:35:02.119172 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:02.119132 2578 generic.go:356] "Generic (PLEG): container finished" podID="af800938-5641-450a-a2ef-968ef7b2da35" containerID="b3f17457088f78beb66e638326798282c9538284c949001170c4894552371e10" exitCode=0 Jul 03 17:35:02.119792 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:02.119195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerDied","Data":"b3f17457088f78beb66e638326798282c9538284c949001170c4894552371e10"} Jul 03 17:35:02.932390 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:02.932334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:02.932559 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:02.932466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:02.932559 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:02.932469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:35:02.932559 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:02.932513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:02.932646 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:02.932599 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:35:02.932692 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:02.932675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:35:03.125343 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:03.125266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lzqst" event={"ID":"af800938-5641-450a-a2ef-968ef7b2da35","Type":"ContainerStarted","Data":"ff2e71e115e24282f66a1e079946d0106a0287289f21f27f06f0e851c821cf71"} Jul 03 17:35:03.154180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:03.154125 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lzqst" podStartSLOduration=9.473722719 podStartE2EDuration="35.154111299s" totalImagesPullingTime="25.68038858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:03.15374211 +0000 UTC m=+35.847839297" watchObservedRunningTime="2026-07-03 17:35:03.154111299 +0000 UTC m=+35.848208495" Jul 03 17:35:04.932975 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:04.932943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:04.933531 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:04.932943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:04.933531 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:04.933056 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-trmsv" podUID="2d9b3968-372d-46d4-adbf-365b888c1429" Jul 03 17:35:04.933531 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:04.932943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:04.933531 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:04.933184 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ng2c" podUID="d6d41ac2-bf75-46e8-b376-57d526a52d19" Jul 03 17:35:04.933531 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:04.933238 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6jg9x" podUID="da70a016-6966-4648-a644-261f0b8dffaa" Jul 03 17:35:05.068288 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.068214 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeReady" Jul 03 17:35:05.068450 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.068343 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 17:35:05.152227 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.152192 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:35:05.158202 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.158178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.163568 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.163542 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 03 17:35:05.163568 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.163563 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 03 17:35:05.164450 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.164431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 03 17:35:05.174036 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.174020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 03 17:35:05.190613 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.190593 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p5m86\"" Jul 03 17:35:05.216487 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.216461 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:35:05.232350 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.232324 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bq7c4"] Jul 03 17:35:05.250499 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.250474 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6xb"] Jul 03 17:35:05.250619 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.250600 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.253479 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.253460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 17:35:05.253607 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.253478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xjgzf\"" Jul 03 17:35:05.253715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.253701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 17:35:05.274356 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.274331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6xb"] Jul 03 17:35:05.274513 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.274460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.276494 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276665 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx4j5\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276879 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276930 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.276930 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.277030 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.276960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.277867 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.277845 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ffdtr\"" Jul 03 17:35:05.278350 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.278331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq7c4"] Jul 03 17:35:05.278678 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.278660 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 17:35:05.279339 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.279055 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 17:35:05.279339 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.279188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 17:35:05.378212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a22761b-3636-4372-b04f-c95b3e85b058-tmp-dir\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.378212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-cert\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.378212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx4j5\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a22761b-3636-4372-b04f-c95b3e85b058-config-volume\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnt8z\" (UniqueName: \"kubernetes.io/projected/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-kube-api-access-nnt8z\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.378469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.378623 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.378643 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.378726 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.378699 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:05.878678274 +0000 UTC m=+38.572775447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:05.379080 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/6a22761b-3636-4372-b04f-c95b3e85b058-kube-api-access-hmz7q\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.379080 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.378781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.379080 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.379069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.379570 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.379549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.382436 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.382419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.382507 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.382447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.395316 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.395290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.396768 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.396745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx4j5\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.479309 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-cert\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.479309 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.479558 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a22761b-3636-4372-b04f-c95b3e85b058-config-volume\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.479558 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt8z\" (UniqueName: \"kubernetes.io/projected/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-kube-api-access-nnt8z\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.479558 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.479461 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:05.479558 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/6a22761b-3636-4372-b04f-c95b3e85b058-kube-api-access-hmz7q\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.479558 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.479542 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:05.979521255 +0000 UTC m=+38.673618447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:05.479776 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a22761b-3636-4372-b04f-c95b3e85b058-tmp-dir\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.479881 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a22761b-3636-4372-b04f-c95b3e85b058-tmp-dir\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.479943 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.479925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a22761b-3636-4372-b04f-c95b3e85b058-config-volume\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.481800 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.481777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-cert\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.490405 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.490384 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz7q\" (UniqueName: \"kubernetes.io/projected/6a22761b-3636-4372-b04f-c95b3e85b058-kube-api-access-hmz7q\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.490673 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.490657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnt8z\" (UniqueName: \"kubernetes.io/projected/f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9-kube-api-access-nnt8z\") pod \"ingress-canary-xj6xb\" (UID: \"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9\") " pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.594888 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.594849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xj6xb" Jul 03 17:35:05.788497 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.788299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6xb"] Jul 03 17:35:05.792991 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:05.792961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c2ebb3_a9ce_45a9_b0ee_dc5a06ba8bc9.slice/crio-1e5042f5221f3735bbc7c6f0a56d5c93604b049c6e8c425b60e354c03283b777 WatchSource:0}: Error finding container 1e5042f5221f3735bbc7c6f0a56d5c93604b049c6e8c425b60e354c03283b777: Status 404 returned error can't find the container with id 1e5042f5221f3735bbc7c6f0a56d5c93604b049c6e8c425b60e354c03283b777 Jul 03 17:35:05.884172 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.884054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:05.884316 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.884224 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:05.884316 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.884244 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:05.884316 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.884308 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:06.884293476 +0000 UTC m=+39.578390650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:05.984660 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:05.984616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:05.985120 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.984773 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:05.985120 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:05.984842 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:06.984822304 +0000 UTC m=+39.678919479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:06.134236 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.134155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xj6xb" event={"ID":"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9","Type":"ContainerStarted","Data":"1e5042f5221f3735bbc7c6f0a56d5c93604b049c6e8c425b60e354c03283b777"} Jul 03 17:35:06.891299 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.891265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:06.891481 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:06.891443 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:06.891481 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:06.891463 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:06.891561 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:06.891522 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:08.891507706 +0000 UTC m=+41.585604881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:06.932666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.932621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:06.932837 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.932641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:06.932837 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.932767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:06.935631 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.935610 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dg8tk\"" Jul 03 17:35:06.936569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.936500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 17:35:06.936569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.936531 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 17:35:06.936569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.936553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 17:35:06.936765 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.936590 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 17:35:06.936765 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.936505 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vrbl\"" Jul 03 17:35:06.991893 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:06.991862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:06.992341 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:06.992008 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:06.992341 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:06.992081 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:08.992061462 +0000 UTC m=+41.686158637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:08.907139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:08.907102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:08.907547 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:08.907251 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:08.907547 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:08.907274 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:08.907547 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:08.907338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:12.907323033 +0000 UTC m=+45.601420207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:09.008354 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:09.008313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:09.008598 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:09.008485 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:09.008598 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:09.008557 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:13.0085411 +0000 UTC m=+45.702638296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:10.145422 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:10.145361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xj6xb" event={"ID":"f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9","Type":"ContainerStarted","Data":"a96f425b5f57a14ce5f40a65a0f08d04e81d6a00fe4728256f386f7543205f14"} Jul 03 17:35:10.169058 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:10.169005 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xj6xb" podStartSLOduration=1.665042812 podStartE2EDuration="5.168986797s" totalImagesPullingTime="3.503943985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:10.168313872 +0000 UTC m=+42.862411094" watchObservedRunningTime="2026-07-03 17:35:10.168986797 +0000 UTC m=+42.863083992" Jul 03 17:35:12.939309 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:12.939115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:12.939682 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:12.939259 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:12.939682 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:12.939366 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:12.939682 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:12.939443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:20.939428779 +0000 UTC m=+53.633525972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:13.040592 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:13.040551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:13.041078 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:13.041054 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:13.041341 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:13.041328 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:21.041304045 +0000 UTC m=+53.735401232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:18.802718 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.802683 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rv9c4"] Jul 03 17:35:18.813006 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.812985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.821705 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.821686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:18.823301 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.823285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 03 17:35:18.834502 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.834470 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t"] Jul 03 17:35:18.837645 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.837627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 03 17:35:18.840698 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.840682 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 03 17:35:18.841051 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.841035 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gcrlw\"" Jul 03 17:35:18.842993 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.842975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:18.849864 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.849840 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x9mqh\"" Jul 03 17:35:18.850657 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.850639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:18.851523 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.851510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 03 17:35:18.865659 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.865636 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 03 17:35:18.866717 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.866695 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t"] Jul 03 17:35:18.880834 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.880810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-serving-cert\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.880953 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.880862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-trusted-ca\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.880953 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.880942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9wxw\" (UniqueName: \"kubernetes.io/projected/4eb0abde-e23c-4476-aec9-e3516ed2f8de-kube-api-access-v9wxw\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:18.881040 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.880966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-config\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.881040 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.880994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjkj\" (UniqueName: \"kubernetes.io/projected/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-kube-api-access-gqjkj\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.881123 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.881076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:18.917416 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.917367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 03 17:35:18.944893 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.944861 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5555d8fdbc-tcw65"] Jul 03 17:35:18.956715 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.956688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.961058 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 03 17:35:18.961176 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961042 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 03 17:35:18.961331 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961318 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xtmwf\"" Jul 03 17:35:18.961367 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 03 17:35:18.961432 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 03 17:35:18.961432 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 17:35:18.961509 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.961430 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 17:35:18.966555 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.966535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rv9c4"] Jul 03 17:35:18.979307 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.979283 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5555d8fdbc-tcw65"] Jul 03 17:35:18.981553 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.981650 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-serving-cert\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.981650 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-trusted-ca\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.981650 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmr57\" (UniqueName: \"kubernetes.io/projected/679c3f30-5d00-4a89-a634-0443fec05d76-kube-api-access-fmr57\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.981804 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9wxw\" (UniqueName: \"kubernetes.io/projected/4eb0abde-e23c-4476-aec9-e3516ed2f8de-kube-api-access-v9wxw\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:18.981838 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-config\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.981886 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.981954 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.981930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-stats-auth\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.982026 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.982007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjkj\" (UniqueName: \"kubernetes.io/projected/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-kube-api-access-gqjkj\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.982075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.982048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-default-certificate\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:18.982298 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.982269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:18.982416 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:18.982400 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:18.982521 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:18.982508 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:19.482491527 +0000 UTC m=+52.176588705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:18.982584 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.982566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-config\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.982968 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.982951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-trusted-ca\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:18.985668 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:18.985648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-serving-cert\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:19.003994 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.003966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9wxw\" (UniqueName: \"kubernetes.io/projected/4eb0abde-e23c-4476-aec9-e3516ed2f8de-kube-api-access-v9wxw\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:19.005685 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.005663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjkj\" (UniqueName: \"kubernetes.io/projected/74895c83-cc2e-44ac-8d1a-c78a37cf66dc-kube-api-access-gqjkj\") pod \"console-operator-68b757fb67-rv9c4\" (UID: \"74895c83-cc2e-44ac-8d1a-c78a37cf66dc\") " pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:19.083581 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.083487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmr57\" (UniqueName: \"kubernetes.io/projected/679c3f30-5d00-4a89-a634-0443fec05d76-kube-api-access-fmr57\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.083581 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.083577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.083768 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.083605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-stats-auth\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.083768 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.083643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-default-certificate\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.083768 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.083723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.083768 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.083755 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:19.583733996 +0000 UTC m=+52.277831177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:19.083926 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.083813 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:19.083926 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.083890 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:19.583875438 +0000 UTC m=+52.277972626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:19.086171 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.086144 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-stats-auth\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.086282 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.086182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-default-certificate\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.092864 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.092839 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmr57\" (UniqueName: \"kubernetes.io/projected/679c3f30-5d00-4a89-a634-0443fec05d76-kube-api-access-fmr57\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.121291 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.121257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:19.263165 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.263007 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rv9c4"] Jul 03 17:35:19.265522 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:19.265496 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74895c83_cc2e_44ac_8d1a_c78a37cf66dc.slice/crio-53fcf2c31eb1c602bec532de1cd18f246f3fdb82d52d68d355a13e762186c9fd WatchSource:0}: Error finding container 53fcf2c31eb1c602bec532de1cd18f246f3fdb82d52d68d355a13e762186c9fd: Status 404 returned error can't find the container with id 53fcf2c31eb1c602bec532de1cd18f246f3fdb82d52d68d355a13e762186c9fd Jul 03 17:35:19.487100 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.487065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:19.487283 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.487217 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:19.487283 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.487281 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:20.487265041 +0000 UTC m=+53.181362232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:19.587675 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.587640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.587871 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:19.587821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:19.587871 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.587835 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:20.587816325 +0000 UTC m=+53.281913502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:19.587997 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.587916 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:19.587997 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:19.587977 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:20.587961566 +0000 UTC m=+53.282058757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:20.171311 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:20.171270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" event={"ID":"74895c83-cc2e-44ac-8d1a-c78a37cf66dc","Type":"ContainerStarted","Data":"53fcf2c31eb1c602bec532de1cd18f246f3fdb82d52d68d355a13e762186c9fd"} Jul 03 17:35:20.497328 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:20.497290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:20.497513 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:20.497460 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:20.497557 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:20.497528 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:22.49751157 +0000 UTC m=+55.191608749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:20.597726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:20.597687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:20.597920 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:20.597795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:20.597920 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:20.597872 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:20.598040 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:20.597926 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:22.597908316 +0000 UTC m=+55.292005490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:20.598040 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:20.597948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:22.597937907 +0000 UTC m=+55.292035083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:21.001906 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:21.001867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:21.002124 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:21.002060 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:21.002124 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:21.002090 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:21.002208 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:21.002160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:37.002141723 +0000 UTC m=+69.696238896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:21.103298 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:21.103252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:21.103511 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:21.103429 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:21.103511 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:21.103496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:37.103480634 +0000 UTC m=+69.797577807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:22.176613 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.176584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/0.log" Jul 03 17:35:22.177003 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.176626 2578 generic.go:356] "Generic (PLEG): container finished" podID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" containerID="6239a58d1b87e5bb9ff67e191fa80169c66c5b5248451b739c1db0d678fe4081" exitCode=255 Jul 03 17:35:22.177003 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.176666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" event={"ID":"74895c83-cc2e-44ac-8d1a-c78a37cf66dc","Type":"ContainerDied","Data":"6239a58d1b87e5bb9ff67e191fa80169c66c5b5248451b739c1db0d678fe4081"} Jul 03 17:35:22.177003 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.176879 2578 scope.go:117] "RemoveContainer" containerID="6239a58d1b87e5bb9ff67e191fa80169c66c5b5248451b739c1db0d678fe4081" Jul 03 17:35:22.513642 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.513607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:22.513855 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:22.513743 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:22.513855 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:22.513807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.513792786 +0000 UTC m=+59.207889982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:22.614936 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.614900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:22.615081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:22.615017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:22.615119 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:22.615078 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.615058044 +0000 UTC m=+59.309155240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:22.615177 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:22.615127 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:22.615177 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:22.615166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:26.615155174 +0000 UTC m=+59.309252349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:23.183166 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/1.log" Jul 03 17:35:23.183604 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/0.log" Jul 03 17:35:23.183648 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183623 2578 generic.go:356] "Generic (PLEG): container finished" podID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" exitCode=255 Jul 03 17:35:23.183680 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" event={"ID":"74895c83-cc2e-44ac-8d1a-c78a37cf66dc","Type":"ContainerDied","Data":"970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87"} Jul 03 17:35:23.183720 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183709 2578 scope.go:117] "RemoveContainer" containerID="6239a58d1b87e5bb9ff67e191fa80169c66c5b5248451b739c1db0d678fe4081" Jul 03 17:35:23.183985 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:23.183964 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:23.184160 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:23.184141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:24.187767 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:24.187735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/1.log" Jul 03 17:35:24.188144 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:24.188066 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:24.188220 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:24.188201 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:26.545244 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.545181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:26.545705 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:26.545331 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:26.545705 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:26.545450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:34.545405685 +0000 UTC m=+67.239502877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:26.646277 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.646235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:26.646457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.646342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:26.646457 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:26.646438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:34.64641561 +0000 UTC m=+67.340512800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:26.646565 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:26.646508 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:26.646565 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:26.646560 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:34.646546481 +0000 UTC m=+67.340643676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:26.933168 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.933088 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pvjfl"] Jul 03 17:35:26.935668 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.935652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:26.940537 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.940514 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7nzzk\"" Jul 03 17:35:26.940681 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.940662 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 17:35:26.941260 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.941244 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 17:35:26.941310 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.941258 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 17:35:26.941964 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.941847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 17:35:26.976875 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:26.976845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pvjfl"] Jul 03 17:35:27.050026 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.049992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.050224 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.050075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53b055a8-caea-4031-aa33-ec66579bdeb4-crio-socket\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.050224 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.050181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.050429 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.050231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53b055a8-caea-4031-aa33-ec66579bdeb4-data-volume\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.050429 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.050263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpq2p\" (UniqueName: \"kubernetes.io/projected/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-api-access-zpq2p\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150731 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53b055a8-caea-4031-aa33-ec66579bdeb4-crio-socket\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53b055a8-caea-4031-aa33-ec66579bdeb4-data-volume\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpq2p\" (UniqueName: \"kubernetes.io/projected/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-api-access-zpq2p\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/53b055a8-caea-4031-aa33-ec66579bdeb4-crio-socket\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.150921 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.150830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.151237 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.150942 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:27.151237 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.150968 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:27.151237 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.151010 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:27.650991446 +0000 UTC m=+60.345088620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:27.151237 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.151029 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:27.651019617 +0000 UTC m=+60.345116791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : configmap "kube-rbac-proxy" not found Jul 03 17:35:27.151237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.151183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/53b055a8-caea-4031-aa33-ec66579bdeb4-data-volume\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.166743 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.166721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpq2p\" (UniqueName: \"kubernetes.io/projected/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-api-access-zpq2p\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.655072 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.655033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.655540 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.655146 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:27.655540 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:27.655179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:27.655540 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.655197 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:28.655181622 +0000 UTC m=+61.349278797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : configmap "kube-rbac-proxy" not found Jul 03 17:35:27.655540 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.655276 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:27.655540 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:27.655333 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:28.655317503 +0000 UTC m=+61.349414695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:28.038000 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.037965 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l"] Jul 03 17:35:28.040593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.040577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" Jul 03 17:35:28.048417 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.048387 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tmd44\"" Jul 03 17:35:28.048532 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.048444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 03 17:35:28.048532 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.048488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 03 17:35:28.064786 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.064754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l"] Jul 03 17:35:28.158478 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.158442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjvm\" (UniqueName: \"kubernetes.io/projected/3149dad8-130d-4375-bfe5-db6a6fbb8929-kube-api-access-5rjvm\") pod \"migrator-d57d58cc9-nfd4l\" (UID: \"3149dad8-130d-4375-bfe5-db6a6fbb8929\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" Jul 03 17:35:28.259559 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.259516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjvm\" (UniqueName: \"kubernetes.io/projected/3149dad8-130d-4375-bfe5-db6a6fbb8929-kube-api-access-5rjvm\") pod \"migrator-d57d58cc9-nfd4l\" (UID: \"3149dad8-130d-4375-bfe5-db6a6fbb8929\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" Jul 03 17:35:28.268926 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.268895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjvm\" (UniqueName: \"kubernetes.io/projected/3149dad8-130d-4375-bfe5-db6a6fbb8929-kube-api-access-5rjvm\") pod \"migrator-d57d58cc9-nfd4l\" (UID: \"3149dad8-130d-4375-bfe5-db6a6fbb8929\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" Jul 03 17:35:28.349050 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.348966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" Jul 03 17:35:28.469670 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.469636 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l"] Jul 03 17:35:28.472639 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:28.472610 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3149dad8_130d_4375_bfe5_db6a6fbb8929.slice/crio-2f50443bce53afaf52a409e702cfbe04e8bb9c25216990f068019d3cb38544f9 WatchSource:0}: Error finding container 2f50443bce53afaf52a409e702cfbe04e8bb9c25216990f068019d3cb38544f9: Status 404 returned error can't find the container with id 2f50443bce53afaf52a409e702cfbe04e8bb9c25216990f068019d3cb38544f9 Jul 03 17:35:28.662878 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.662793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:28.662878 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.662854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:28.663269 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:28.662930 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:28.663269 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:28.662956 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:28.663269 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:28.662983 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:30.662968937 +0000 UTC m=+63.357066111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : configmap "kube-rbac-proxy" not found Jul 03 17:35:28.663269 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:28.663044 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:30.663024649 +0000 UTC m=+63.357121825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:28.740069 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:28.740042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xp8nd_81fa9c97-5e51-43a6-a391-e452a7270939/dns-node-resolver/0.log" Jul 03 17:35:29.121348 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.121312 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:29.121549 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.121447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:29.121797 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.121780 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:29.121983 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:29.121963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:29.201128 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.201085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" event={"ID":"3149dad8-130d-4375-bfe5-db6a6fbb8929","Type":"ContainerStarted","Data":"2f50443bce53afaf52a409e702cfbe04e8bb9c25216990f068019d3cb38544f9"} Jul 03 17:35:29.201423 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.201408 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:29.201606 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:29.201580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:29.330692 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:29.330663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92dhm_8a3cd672-8715-4970-b492-8aa397244b58/node-ca/0.log" Jul 03 17:35:30.120606 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.120579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-99dht" Jul 03 17:35:30.205072 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.205035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" event={"ID":"3149dad8-130d-4375-bfe5-db6a6fbb8929","Type":"ContainerStarted","Data":"d5530525323224c4760eb48b80acc4c7d69dc01000cf946297c436b5b70f4374"} Jul 03 17:35:30.205234 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.205085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" event={"ID":"3149dad8-130d-4375-bfe5-db6a6fbb8929","Type":"ContainerStarted","Data":"573bf9c61d0a69d8c4b96089fab1ea1470d79ccaa923aecd3f30270f4a92ebe9"} Jul 03 17:35:30.256559 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.256506 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nfd4l" podStartSLOduration=2.091353683 podStartE2EDuration="3.256491681s" totalImagesPullingTime="1.165137998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:30.255536987 +0000 UTC m=+62.949634183" watchObservedRunningTime="2026-07-03 17:35:30.256491681 +0000 UTC m=+62.950588896" Jul 03 17:35:30.329440 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.329399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xj6xb_f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9/serve-healthcheck-canary/0.log" Jul 03 17:35:30.680049 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.679994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:30.680775 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:30.680487 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:30.680775 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:30.680509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:30.680775 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:30.680627 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:34.680600814 +0000 UTC m=+67.374698006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:30.680775 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:30.680672 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:30.680775 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:30.680731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:34.680718611 +0000 UTC m=+67.374815797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : configmap "kube-rbac-proxy" not found Jul 03 17:35:33.504895 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.504849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:35:33.508150 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.508131 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 17:35:33.515240 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:33.515222 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 03 17:35:33.515308 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:33.515298 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs podName:d6d41ac2-bf75-46e8-b376-57d526a52d19 nodeName:}" failed. No retries permitted until 2026-07-03 17:36:37.515282863 +0000 UTC m=+130.209380051 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs") pod "network-metrics-daemon-2ng2c" (UID: "d6d41ac2-bf75-46e8-b376-57d526a52d19") : secret "metrics-daemon-secret" not found Jul 03 17:35:33.606035 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.605997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:33.608765 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.608739 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 17:35:33.619120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.619094 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d9b3968-372d-46d4-adbf-365b888c1429-original-pull-secret\") pod \"global-pull-secret-syncer-trmsv\" (UID: \"2d9b3968-372d-46d4-adbf-365b888c1429\") " pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:33.646220 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.646187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-trmsv" Jul 03 17:35:33.706452 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.706421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:33.710742 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.710719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 17:35:33.719751 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.719725 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 17:35:33.730357 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.730328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4d6t\" (UniqueName: \"kubernetes.io/projected/da70a016-6966-4648-a644-261f0b8dffaa-kube-api-access-s4d6t\") pod \"network-check-target-6jg9x\" (UID: \"da70a016-6966-4648-a644-261f0b8dffaa\") " pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:33.782863 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.782774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-trmsv"] Jul 03 17:35:33.786340 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:33.786317 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9b3968_372d_46d4_adbf_365b888c1429.slice/crio-f07a5cacbe39460ef6a8591e8a35539a91870d171203f2aeab7a23e4c436e1cf WatchSource:0}: Error finding container f07a5cacbe39460ef6a8591e8a35539a91870d171203f2aeab7a23e4c436e1cf: Status 404 returned error can't find the container with id f07a5cacbe39460ef6a8591e8a35539a91870d171203f2aeab7a23e4c436e1cf Jul 03 17:35:33.955619 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.955589 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dg8tk\"" Jul 03 17:35:33.963968 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:33.963943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:34.113448 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.113415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6jg9x"] Jul 03 17:35:34.116545 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:34.116513 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda70a016_6966_4648_a644_261f0b8dffaa.slice/crio-32050b8e8aa42847fc6c1a11805a1fe6bb7d07515459cb772e6a035e806644b7 WatchSource:0}: Error finding container 32050b8e8aa42847fc6c1a11805a1fe6bb7d07515459cb772e6a035e806644b7: Status 404 returned error can't find the container with id 32050b8e8aa42847fc6c1a11805a1fe6bb7d07515459cb772e6a035e806644b7 Jul 03 17:35:34.215443 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.215412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jg9x" event={"ID":"da70a016-6966-4648-a644-261f0b8dffaa","Type":"ContainerStarted","Data":"32050b8e8aa42847fc6c1a11805a1fe6bb7d07515459cb772e6a035e806644b7"} Jul 03 17:35:34.216473 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.216449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-trmsv" event={"ID":"2d9b3968-372d-46d4-adbf-365b888c1429","Type":"ContainerStarted","Data":"f07a5cacbe39460ef6a8591e8a35539a91870d171203f2aeab7a23e4c436e1cf"} Jul 03 17:35:34.614199 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.614141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:34.614669 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.614323 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 03 17:35:34.614669 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.614423 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls podName:4eb0abde-e23c-4476-aec9-e3516ed2f8de nodeName:}" failed. No retries permitted until 2026-07-03 17:35:50.614401582 +0000 UTC m=+83.308498758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-9576t" (UID: "4eb0abde-e23c-4476-aec9-e3516ed2f8de") : secret "samples-operator-tls" not found Jul 03 17:35:34.715554 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.715511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:34.715723 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.715577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:34.715723 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.715632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:34.715723 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715659 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 17:35:34.715723 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715687 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:34.715723 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:34.715666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:34.716044 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715740 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:42.715718725 +0000 UTC m=+75.409815899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : configmap "kube-rbac-proxy" not found Jul 03 17:35:34.716044 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715769 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 03 17:35:34.716044 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715785 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:42.715773317 +0000 UTC m=+75.409870496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:34.716044 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:50.715795523 +0000 UTC m=+83.409892698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : configmap references non-existent config key: service-ca.crt Jul 03 17:35:34.716044 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:34.715830 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs podName:679c3f30-5d00-4a89-a634-0443fec05d76 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:50.715814381 +0000 UTC m=+83.409911571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs") pod "router-default-5555d8fdbc-tcw65" (UID: "679c3f30-5d00-4a89-a634-0443fec05d76") : secret "router-metrics-certs-default" not found Jul 03 17:35:37.038950 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:37.038898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:35:37.039356 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:37.039093 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 17:35:37.039356 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:37.039116 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84d54b67bc-pjp9d: secret "image-registry-tls" not found Jul 03 17:35:37.039356 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:37.039179 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls podName:09479745-a657-425c-91cd-10945e9cc937 nodeName:}" failed. No retries permitted until 2026-07-03 17:36:09.039162114 +0000 UTC m=+101.733259292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls") pod "image-registry-84d54b67bc-pjp9d" (UID: "09479745-a657-425c-91cd-10945e9cc937") : secret "image-registry-tls" not found Jul 03 17:35:37.140278 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:37.140239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:35:37.140456 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:37.140401 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 17:35:37.140505 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:37.140466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls podName:6a22761b-3636-4372-b04f-c95b3e85b058 nodeName:}" failed. No retries permitted until 2026-07-03 17:36:09.140451221 +0000 UTC m=+101.834548398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls") pod "dns-default-bq7c4" (UID: "6a22761b-3636-4372-b04f-c95b3e85b058") : secret "dns-default-metrics-tls" not found Jul 03 17:35:39.231687 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:39.231646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6jg9x" event={"ID":"da70a016-6966-4648-a644-261f0b8dffaa","Type":"ContainerStarted","Data":"de9606dcccbfb0d4b67ef17314e2aa76cd9d755a02918d630361613fc2ca2cf7"} Jul 03 17:35:39.232139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:39.231834 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:35:39.233070 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:39.233046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-trmsv" event={"ID":"2d9b3968-372d-46d4-adbf-365b888c1429","Type":"ContainerStarted","Data":"571f786717fd46cfa44d6726a3b74d26a3342e872e0c11156f0b24b174836951"} Jul 03 17:35:39.263255 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:39.263206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6jg9x" podStartSLOduration=67.013946247 podStartE2EDuration="1m11.263193428s" totalImagesPullingTime="4.249247181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:39.26215526 +0000 UTC m=+71.956252456" watchObservedRunningTime="2026-07-03 17:35:39.263193428 +0000 UTC m=+71.957290602" Jul 03 17:35:39.287966 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:39.287911 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-trmsv" podStartSLOduration=66.704715062 podStartE2EDuration="1m11.287895847s" totalImagesPullingTime="4.583180785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:39.287043242 +0000 UTC m=+71.981140437" watchObservedRunningTime="2026-07-03 17:35:39.287895847 +0000 UTC m=+71.981993043" Jul 03 17:35:40.932985 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:40.932951 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:41.248263 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.248235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:35:41.248707 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.248692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/1.log" Jul 03 17:35:41.248758 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.248724 2578 generic.go:356] "Generic (PLEG): container finished" podID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" containerID="6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6" exitCode=255 Jul 03 17:35:41.248758 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.248751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" event={"ID":"74895c83-cc2e-44ac-8d1a-c78a37cf66dc","Type":"ContainerDied","Data":"6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6"} Jul 03 17:35:41.248824 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.248795 2578 scope.go:117] "RemoveContainer" containerID="970bcc562906e703de635b88dc0b801e5b53ef168e2f2fcd98a798e0d6e0ce87" Jul 03 17:35:41.249105 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:41.249087 2578 scope.go:117] "RemoveContainer" containerID="6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6" Jul 03 17:35:41.249283 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:41.249260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:42.253194 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:42.253161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:35:42.791262 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:42.791221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:42.791518 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:42.791330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:42.791518 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:42.791439 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 17:35:42.791518 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:42.791489 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls podName:53b055a8-caea-4031-aa33-ec66579bdeb4 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:58.791475131 +0000 UTC m=+91.485572307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pvjfl" (UID: "53b055a8-caea-4031-aa33-ec66579bdeb4") : secret "insights-runtime-extractor-tls" not found Jul 03 17:35:42.791750 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:42.791730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/53b055a8-caea-4031-aa33-ec66579bdeb4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:49.121960 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:49.121917 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:49.122340 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:49.121983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:35:49.122340 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:49.122279 2578 scope.go:117] "RemoveContainer" containerID="6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6" Jul 03 17:35:49.122501 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:49.122478 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:35:50.653975 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.653819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:50.656192 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.656163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4eb0abde-e23c-4476-aec9-e3516ed2f8de-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-9576t\" (UID: \"4eb0abde-e23c-4476-aec9-e3516ed2f8de\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:50.754960 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.754911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:50.755129 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.754998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:50.755640 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.755622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/679c3f30-5d00-4a89-a634-0443fec05d76-service-ca-bundle\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:50.757417 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.757362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/679c3f30-5d00-4a89-a634-0443fec05d76-metrics-certs\") pod \"router-default-5555d8fdbc-tcw65\" (UID: \"679c3f30-5d00-4a89-a634-0443fec05d76\") " pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:50.768364 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.768337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xtmwf\"" Jul 03 17:35:50.775362 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.775333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:50.901460 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.901426 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5555d8fdbc-tcw65"] Jul 03 17:35:50.905813 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:50.905742 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679c3f30_5d00_4a89_a634_0443fec05d76.slice/crio-1e2c0639dfe29b9bfae5ef7337828721d018e3d2cab5ddc3427ae7c27813171d WatchSource:0}: Error finding container 1e2c0639dfe29b9bfae5ef7337828721d018e3d2cab5ddc3427ae7c27813171d: Status 404 returned error can't find the container with id 1e2c0639dfe29b9bfae5ef7337828721d018e3d2cab5ddc3427ae7c27813171d Jul 03 17:35:50.953347 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.953327 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x9mqh\"" Jul 03 17:35:50.961348 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:50.961321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" Jul 03 17:35:51.083987 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.083953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t"] Jul 03 17:35:51.284910 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.284873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" event={"ID":"679c3f30-5d00-4a89-a634-0443fec05d76","Type":"ContainerStarted","Data":"b7b22ba117c4ea36694b7d93ca08fff9787adb1ffceae38a63b876113ef5ff57"} Jul 03 17:35:51.285108 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.284927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" event={"ID":"679c3f30-5d00-4a89-a634-0443fec05d76","Type":"ContainerStarted","Data":"1e2c0639dfe29b9bfae5ef7337828721d018e3d2cab5ddc3427ae7c27813171d"} Jul 03 17:35:51.285952 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.285928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" event={"ID":"4eb0abde-e23c-4476-aec9-e3516ed2f8de","Type":"ContainerStarted","Data":"5b5cb5859fcb949868cb0529e8bb3ae9b1313ef6b2df5d31e3f1018fd5d08ea6"} Jul 03 17:35:51.307592 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.307546 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" podStartSLOduration=33.30753088 podStartE2EDuration="33.30753088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:51.30696082 +0000 UTC m=+84.001057999" watchObservedRunningTime="2026-07-03 17:35:51.30753088 +0000 UTC m=+84.001628076" Jul 03 17:35:51.776169 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.776135 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:51.779117 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:51.779090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:52.289603 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:52.289568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:52.290971 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:52.290941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5555d8fdbc-tcw65" Jul 03 17:35:53.293950 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:53.293913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" event={"ID":"4eb0abde-e23c-4476-aec9-e3516ed2f8de","Type":"ContainerStarted","Data":"b3d4cb68a36c7c7b2ec2b850cd6336d2ff7fa719c15d91d6fe3c807abe4c12c7"} Jul 03 17:35:53.294451 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:53.293967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" event={"ID":"4eb0abde-e23c-4476-aec9-e3516ed2f8de","Type":"ContainerStarted","Data":"7f08d0d5213583fe30f99060272575bf56bceaf9de7ee54ce3f17786dc2ec970"} Jul 03 17:35:53.321383 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:53.321322 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-9576t" podStartSLOduration=33.8093844 podStartE2EDuration="35.321308018s" totalImagesPullingTime="1.511923618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:53.320579646 +0000 UTC m=+86.014676843" watchObservedRunningTime="2026-07-03 17:35:53.321308018 +0000 UTC m=+86.015405255" Jul 03 17:35:55.842533 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.842497 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc"] Jul 03 17:35:55.845552 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.845534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:55.848683 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.848666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 03 17:35:55.849036 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.849020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f44vx\"" Jul 03 17:35:55.855841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.855818 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc"] Jul 03 17:35:55.994055 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:55.994018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vqkwc\" (UID: \"bba4f27e-162e-4ac9-af50-7d08f692ce84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:56.094894 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:56.094821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vqkwc\" (UID: \"bba4f27e-162e-4ac9-af50-7d08f692ce84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:56.095029 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:56.094939 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 03 17:35:56.095029 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:35:56.095006 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates podName:bba4f27e-162e-4ac9-af50-7d08f692ce84 nodeName:}" failed. No retries permitted until 2026-07-03 17:35:56.594989973 +0000 UTC m=+89.289087147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-vqkwc" (UID: "bba4f27e-162e-4ac9-af50-7d08f692ce84") : secret "prometheus-operator-admission-webhook-tls" not found Jul 03 17:35:56.598127 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:56.598089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vqkwc\" (UID: \"bba4f27e-162e-4ac9-af50-7d08f692ce84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:56.600689 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:56.600666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bba4f27e-162e-4ac9-af50-7d08f692ce84-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vqkwc\" (UID: \"bba4f27e-162e-4ac9-af50-7d08f692ce84\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:56.754162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:56.754122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:56.875772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:56.875672 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc"] Jul 03 17:35:56.878652 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:56.878624 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba4f27e_162e_4ac9_af50_7d08f692ce84.slice/crio-8382243de34a7101ab05401539c18ef92b0c276bc5c165db7724fcbf0e73b283 WatchSource:0}: Error finding container 8382243de34a7101ab05401539c18ef92b0c276bc5c165db7724fcbf0e73b283: Status 404 returned error can't find the container with id 8382243de34a7101ab05401539c18ef92b0c276bc5c165db7724fcbf0e73b283 Jul 03 17:35:57.306297 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:57.306262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" event={"ID":"bba4f27e-162e-4ac9-af50-7d08f692ce84","Type":"ContainerStarted","Data":"8382243de34a7101ab05401539c18ef92b0c276bc5c165db7724fcbf0e73b283"} Jul 03 17:35:58.311353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.311265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" event={"ID":"bba4f27e-162e-4ac9-af50-7d08f692ce84","Type":"ContainerStarted","Data":"f7227f1e2305dc5552b945c7f4615fd0cbdf0a1341f7b72957965f1b796c0144"} Jul 03 17:35:58.311849 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.311485 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:58.315971 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.315952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" Jul 03 17:35:58.329178 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.329129 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vqkwc" podStartSLOduration=2.16535017 podStartE2EDuration="3.329116065s" totalImagesPullingTime="1.163765895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:35:58.32862039 +0000 UTC m=+91.022717583" watchObservedRunningTime="2026-07-03 17:35:58.329116065 +0000 UTC m=+91.023213260" Jul 03 17:35:58.815863 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.815827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:58.818259 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:58.818230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/53b055a8-caea-4031-aa33-ec66579bdeb4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvjfl\" (UID: \"53b055a8-caea-4031-aa33-ec66579bdeb4\") " pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:59.051609 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:59.051571 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7nzzk\"" Jul 03 17:35:59.054847 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:59.054814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pvjfl" Jul 03 17:35:59.182833 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:59.182805 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pvjfl"] Jul 03 17:35:59.186750 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:35:59.186720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b055a8_caea_4031_aa33_ec66579bdeb4.slice/crio-53809381f6c3f3100a4beb9d6bbf310047196d11c53cd0dd96e92ffe8f6b4371 WatchSource:0}: Error finding container 53809381f6c3f3100a4beb9d6bbf310047196d11c53cd0dd96e92ffe8f6b4371: Status 404 returned error can't find the container with id 53809381f6c3f3100a4beb9d6bbf310047196d11c53cd0dd96e92ffe8f6b4371 Jul 03 17:35:59.319445 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:35:59.319405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvjfl" event={"ID":"53b055a8-caea-4031-aa33-ec66579bdeb4","Type":"ContainerStarted","Data":"53809381f6c3f3100a4beb9d6bbf310047196d11c53cd0dd96e92ffe8f6b4371"} Jul 03 17:36:00.932769 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:00.932742 2578 scope.go:117] "RemoveContainer" containerID="6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6" Jul 03 17:36:00.933165 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:00.932903 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-rv9c4_openshift-console-operator(74895c83-cc2e-44ac-8d1a-c78a37cf66dc)\"" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podUID="74895c83-cc2e-44ac-8d1a-c78a37cf66dc" Jul 03 17:36:03.334726 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:03.334688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvjfl" event={"ID":"53b055a8-caea-4031-aa33-ec66579bdeb4","Type":"ContainerStarted","Data":"1f678fa849796e4181585ea76cc93732fa496fe7d4effcc8f7d63d145b147b8b"} Jul 03 17:36:04.345907 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:04.345868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvjfl" event={"ID":"53b055a8-caea-4031-aa33-ec66579bdeb4","Type":"ContainerStarted","Data":"89d407624ae0429bc8e7a046ab09a88b6a6faaeaa03ffbc673ee974e96b9af1e"} Jul 03 17:36:06.354846 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.354809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvjfl" event={"ID":"53b055a8-caea-4031-aa33-ec66579bdeb4","Type":"ContainerStarted","Data":"095aaf213476fa81025c51061749a120477c7455e467e4c79759895d5544ba30"} Jul 03 17:36:06.386232 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.386178 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pvjfl" podStartSLOduration=33.793564959 podStartE2EDuration="40.386161053s" totalImagesPullingTime="6.592596094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:35:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:06.385035282 +0000 UTC m=+99.079132489" watchObservedRunningTime="2026-07-03 17:36:06.386161053 +0000 UTC m=+99.080258250" Jul 03 17:36:06.473129 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.473090 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2"] Jul 03 17:36:06.476440 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.476416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.481182 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.481000 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 03 17:36:06.481182 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.481081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nbgzw\"" Jul 03 17:36:06.481367 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.481234 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 03 17:36:06.481367 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.481324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 17:36:06.481683 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.481668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 17:36:06.487539 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.487523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 03 17:36:06.487623 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.487538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 17:36:06.503650 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.503616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2"] Jul 03 17:36:06.519468 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.519430 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g4r2f"] Jul 03 17:36:06.522809 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.522788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.526061 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:06.526033 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jul 03 17:36:06.526179 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:06.526081 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jul 03 17:36:06.526179 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:06.526148 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-fgmxs\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fgmxs\"" type="*v1.Secret" Jul 03 17:36:06.527290 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:06.527269 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jul 03 17:36:06.585969 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.585930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.585969 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.585974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/499032c0-c26f-4c50-bab9-bc8eca973e83-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.586207 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.586001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.586207 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.586046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.586207 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.586078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.586207 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.586146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lz64\" (UniqueName: \"kubernetes.io/projected/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-api-access-9lz64\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.686809 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569sg\" (UniqueName: \"kubernetes.io/projected/4f5244e6-4dfc-4992-9235-6c0167d269d9-kube-api-access-569sg\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-sys\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.686947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lz64\" (UniqueName: \"kubernetes.io/projected/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-api-access-9lz64\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-metrics-client-ca\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-root\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-tls\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-wtmp\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-textfile\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687428 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/499032c0-c26f-4c50-bab9-bc8eca973e83-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687653 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/499032c0-c26f-4c50-bab9-bc8eca973e83-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687822 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.687858 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.687848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499032c0-c26f-4c50-bab9-bc8eca973e83-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.689417 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.689397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.689478 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.689400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.697104 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.697081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lz64\" (UniqueName: \"kubernetes.io/projected/499032c0-c26f-4c50-bab9-bc8eca973e83-kube-api-access-9lz64\") pod \"kube-state-metrics-7c9dbb8b7d-n9nt2\" (UID: \"499032c0-c26f-4c50-bab9-bc8eca973e83\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.785121 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.785086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" Jul 03 17:36:06.788446 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-wtmp\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788570 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788570 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-textfile\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788675 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569sg\" (UniqueName: \"kubernetes.io/projected/4f5244e6-4dfc-4992-9235-6c0167d269d9-kube-api-access-569sg\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788675 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-wtmp\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788675 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-sys\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788772 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788823 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-metrics-client-ca\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788879 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-root\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788879 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-sys\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.788879 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-textfile\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.789017 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f5244e6-4dfc-4992-9235-6c0167d269d9-root\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.789017 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.788879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-tls\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.789393 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.789330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-metrics-client-ca\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.799687 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.799658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-569sg\" (UniqueName: \"kubernetes.io/projected/4f5244e6-4dfc-4992-9235-6c0167d269d9-kube-api-access-569sg\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:06.913891 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:06.913845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2"] Jul 03 17:36:06.917503 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:06.917477 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499032c0_c26f_4c50_bab9_bc8eca973e83.slice/crio-5bbce3ea419d318db891ca208020a5947d7073a0eb15b2e265029c3c26f52daa WatchSource:0}: Error finding container 5bbce3ea419d318db891ca208020a5947d7073a0eb15b2e265029c3c26f52daa: Status 404 returned error can't find the container with id 5bbce3ea419d318db891ca208020a5947d7073a0eb15b2e265029c3c26f52daa Jul 03 17:36:07.358962 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.358920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" event={"ID":"499032c0-c26f-4c50-bab9-bc8eca973e83","Type":"ContainerStarted","Data":"5bbce3ea419d318db891ca208020a5947d7073a0eb15b2e265029c3c26f52daa"} Jul 03 17:36:07.380236 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.380212 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 17:36:07.389749 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.389722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:07.426681 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.426651 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fgmxs\"" Jul 03 17:36:07.562162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.562130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 17:36:07.571957 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.571928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-tls\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:07.662841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.662756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:07.685066 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.685027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.689834 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.689786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 17:36:07.690032 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 17:36:07.690032 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 17:36:07.690228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690106 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 17:36:07.690228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gbkvq\"" Jul 03 17:36:07.690228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 17:36:07.690400 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690251 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 17:36:07.690580 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690560 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 17:36:07.690666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 17:36:07.690967 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.690951 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 17:36:07.699386 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.699328 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:07.788994 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:07.788965 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Jul 03 17:36:07.789176 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:36:07.789046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config podName:4f5244e6-4dfc-4992-9235-6c0167d269d9 nodeName:}" failed. No retries permitted until 2026-07-03 17:36:08.289025265 +0000 UTC m=+100.983122453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config") pod "node-exporter-g4r2f" (UID: "4f5244e6-4dfc-4992-9235-6c0167d269d9") : failed to sync secret cache: timed out waiting for the condition Jul 03 17:36:07.798494 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798633 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798633 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798633 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798633 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798842 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798842 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwzk\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798942 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798942 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.798942 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.799095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.799095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.798972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.799095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.799004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.900877 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.900839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwzk\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.900877 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.900885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.901710 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.901558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.902648 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.902619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.903215 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.902887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.904748 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.904720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.904848 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.904723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.905198 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.905163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.905198 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.905194 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.905768 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.905736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.906165 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.906121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.906644 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.906614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.906961 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.906925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.907459 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.907436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:07.921422 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:07.921334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwzk\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk\") pod \"alertmanager-main-0\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.002637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.002597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:36:08.071826 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.070603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 17:36:08.174849 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.174688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:36:08.303862 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.303826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:08.306330 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.306304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f5244e6-4dfc-4992-9235-6c0167d269d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4r2f\" (UID: \"4f5244e6-4dfc-4992-9235-6c0167d269d9\") " pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:08.331477 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.331444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4r2f" Jul 03 17:36:08.427314 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:08.427242 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa87b1c_31af_4ac0_96ba_47dfb605ae78.slice/crio-b6423e18e75009d577ae746cca7ad9d9deddd50796d32dc1d76208f6bbbd4c47 WatchSource:0}: Error finding container b6423e18e75009d577ae746cca7ad9d9deddd50796d32dc1d76208f6bbbd4c47: Status 404 returned error can't find the container with id b6423e18e75009d577ae746cca7ad9d9deddd50796d32dc1d76208f6bbbd4c47 Jul 03 17:36:08.433141 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:08.433117 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5244e6_4dfc_4992_9235_6c0167d269d9.slice/crio-bf8c032cd3d8fa576a02719d340a4fb9220598491acbff38cd7fb59ab8eb41de WatchSource:0}: Error finding container bf8c032cd3d8fa576a02719d340a4fb9220598491acbff38cd7fb59ab8eb41de: Status 404 returned error can't find the container with id bf8c032cd3d8fa576a02719d340a4fb9220598491acbff38cd7fb59ab8eb41de Jul 03 17:36:08.746343 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.746313 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6dc8f885b7-w7nml"] Jul 03 17:36:08.768738 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.768713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.776150 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.776124 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dc8f885b7-w7nml"] Jul 03 17:36:08.782043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 03 17:36:08.782162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eudtpqu2fdcfc\"" Jul 03 17:36:08.782162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782068 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 03 17:36:08.782162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782091 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 03 17:36:08.782162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 03 17:36:08.782554 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782538 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 03 17:36:08.782638 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.782621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z96nc\"" Jul 03 17:36:08.807077 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-grpc-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807158 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807158 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kbk\" (UniqueName: \"kubernetes.io/projected/f518660b-5e74-4a07-96ce-3cb1f695a57e-kube-api-access-n6kbk\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807242 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807275 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807330 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807391 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f518660b-5e74-4a07-96ce-3cb1f695a57e-metrics-client-ca\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.807391 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.807366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.907881 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.907843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.907891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.907949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.907996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f518660b-5e74-4a07-96ce-3cb1f695a57e-metrics-client-ca\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.908030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908294 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.908077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-grpc-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908294 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.908113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.908294 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.908142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kbk\" (UniqueName: \"kubernetes.io/projected/f518660b-5e74-4a07-96ce-3cb1f695a57e-kube-api-access-n6kbk\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.909247 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.909219 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f518660b-5e74-4a07-96ce-3cb1f695a57e-metrics-client-ca\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.910900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.910869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.911126 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.911072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.911231 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.911187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.911289 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.911253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.911624 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.911604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-grpc-tls\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.911986 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.911965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f518660b-5e74-4a07-96ce-3cb1f695a57e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:08.927466 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:08.927437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kbk\" (UniqueName: \"kubernetes.io/projected/f518660b-5e74-4a07-96ce-3cb1f695a57e-kube-api-access-n6kbk\") pod \"thanos-querier-6dc8f885b7-w7nml\" (UID: \"f518660b-5e74-4a07-96ce-3cb1f695a57e\") " pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:09.078537 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.078507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:09.110813 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.110725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:09.113464 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.113440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"image-registry-84d54b67bc-pjp9d\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:09.212157 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.211631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:36:09.216039 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.215736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a22761b-3636-4372-b04f-c95b3e85b058-metrics-tls\") pod \"dns-default-bq7c4\" (UID: \"6a22761b-3636-4372-b04f-c95b3e85b058\") " pod="openshift-dns/dns-default-bq7c4" Jul 03 17:36:09.276622 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.276475 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dc8f885b7-w7nml"] Jul 03 17:36:09.372598 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.372560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4r2f" event={"ID":"4f5244e6-4dfc-4992-9235-6c0167d269d9","Type":"ContainerStarted","Data":"bf8c032cd3d8fa576a02719d340a4fb9220598491acbff38cd7fb59ab8eb41de"} Jul 03 17:36:09.373350 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.373326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p5m86\"" Jul 03 17:36:09.374702 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.374677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"b6423e18e75009d577ae746cca7ad9d9deddd50796d32dc1d76208f6bbbd4c47"} Jul 03 17:36:09.377335 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.377304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" event={"ID":"499032c0-c26f-4c50-bab9-bc8eca973e83","Type":"ContainerStarted","Data":"12f5dd42ad936923bc1ded49c36465886b5f43aabb0b160636b18036902d7848"} Jul 03 17:36:09.377460 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.377366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" event={"ID":"499032c0-c26f-4c50-bab9-bc8eca973e83","Type":"ContainerStarted","Data":"4f26186c9b9ff61705213978450cc402cffeb8436c0068a10c06d2720b6a5c82"} Jul 03 17:36:09.377460 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.377418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" event={"ID":"499032c0-c26f-4c50-bab9-bc8eca973e83","Type":"ContainerStarted","Data":"ce6e64d4770ac5a60a9d0842d07b0e90ef370ef6c6b01a20c4183c98c3376968"} Jul 03 17:36:09.378804 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.378778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:09.458582 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.458479 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n9nt2" podStartSLOduration=1.571131804 podStartE2EDuration="3.458457407s" totalImagesPullingTime="1.887325603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:09.457965399 +0000 UTC m=+102.152062609" watchObservedRunningTime="2026-07-03 17:36:09.458457407 +0000 UTC m=+102.152554607" Jul 03 17:36:09.467523 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.467490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xjgzf\"" Jul 03 17:36:09.469602 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:09.469576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq7c4" Jul 03 17:36:09.882218 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:09.882180 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf518660b_5e74_4a07_96ce_3cb1f695a57e.slice/crio-7528146052c64523dc722d9097d0c5f34045e57c7049c0da2fb76a53f7e7a858 WatchSource:0}: Error finding container 7528146052c64523dc722d9097d0c5f34045e57c7049c0da2fb76a53f7e7a858: Status 404 returned error can't find the container with id 7528146052c64523dc722d9097d0c5f34045e57c7049c0da2fb76a53f7e7a858 Jul 03 17:36:10.244614 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.244591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6jg9x" Jul 03 17:36:10.382531 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.382496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"7528146052c64523dc722d9097d0c5f34045e57c7049c0da2fb76a53f7e7a858"} Jul 03 17:36:10.435572 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.435540 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq7c4"] Jul 03 17:36:10.440135 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:10.440105 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a22761b_3636_4372_b04f_c95b3e85b058.slice/crio-d7e9cd1b60a2a4d35b996c4e89408b0cd217b4dbee350c87d34c1b58a38f9d0d WatchSource:0}: Error finding container d7e9cd1b60a2a4d35b996c4e89408b0cd217b4dbee350c87d34c1b58a38f9d0d: Status 404 returned error can't find the container with id d7e9cd1b60a2a4d35b996c4e89408b0cd217b4dbee350c87d34c1b58a38f9d0d Jul 03 17:36:10.459133 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.459109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:36:10.510426 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:10.510323 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09479745_a657_425c_91cd_10945e9cc937.slice/crio-d8172d419f0ee0542a6d64d52b32885cd4bd849399631fd303db628ecd197fd0 WatchSource:0}: Error finding container d8172d419f0ee0542a6d64d52b32885cd4bd849399631fd303db628ecd197fd0: Status 404 returned error can't find the container with id d8172d419f0ee0542a6d64d52b32885cd4bd849399631fd303db628ecd197fd0 Jul 03 17:36:10.875212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.875132 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55579ccd4b-s7kx4"] Jul 03 17:36:10.880693 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.880668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.884386 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.884355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 03 17:36:10.884544 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.884526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 17:36:10.885141 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.885118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 03 17:36:10.885236 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.885200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q6xc4\"" Jul 03 17:36:10.885770 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.885752 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 03 17:36:10.885887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.885834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ds0u1pof54r2o\"" Jul 03 17:36:10.903277 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.903208 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55579ccd4b-s7kx4"] Jul 03 17:36:10.926886 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.926851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927048 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.926913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80f167ee-7a6a-4875-a269-c2f8a2241ae1-audit-log\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927048 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.926956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-client-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927048 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.926987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xxbx\" (UniqueName: \"kubernetes.io/projected/80f167ee-7a6a-4875-a269-c2f8a2241ae1-kube-api-access-2xxbx\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927048 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.927025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-client-certs\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927279 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.927055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-tls\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:10.927279 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:10.927128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-metrics-server-audit-profiles\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028151 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-metrics-server-audit-profiles\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80f167ee-7a6a-4875-a269-c2f8a2241ae1-audit-log\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-client-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxbx\" (UniqueName: \"kubernetes.io/projected/80f167ee-7a6a-4875-a269-c2f8a2241ae1-kube-api-access-2xxbx\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-client-certs\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.028325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-tls\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.029037 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.028982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.029181 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.029048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/80f167ee-7a6a-4875-a269-c2f8a2241ae1-audit-log\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.029254 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.029209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/80f167ee-7a6a-4875-a269-c2f8a2241ae1-metrics-server-audit-profiles\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.031569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.031544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-client-ca-bundle\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.032228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.032184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-tls\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.033244 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.033200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/80f167ee-7a6a-4875-a269-c2f8a2241ae1-secret-metrics-server-client-certs\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.046107 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.046055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxbx\" (UniqueName: \"kubernetes.io/projected/80f167ee-7a6a-4875-a269-c2f8a2241ae1-kube-api-access-2xxbx\") pod \"metrics-server-55579ccd4b-s7kx4\" (UID: \"80f167ee-7a6a-4875-a269-c2f8a2241ae1\") " pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.193849 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.193765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:11.372358 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.372333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55579ccd4b-s7kx4"] Jul 03 17:36:11.374405 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:11.374360 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f167ee_7a6a_4875_a269_c2f8a2241ae1.slice/crio-840af83d265fd257ca4c53a606be2731921e864b348cb7eaa94a03f46374631b WatchSource:0}: Error finding container 840af83d265fd257ca4c53a606be2731921e864b348cb7eaa94a03f46374631b: Status 404 returned error can't find the container with id 840af83d265fd257ca4c53a606be2731921e864b348cb7eaa94a03f46374631b Jul 03 17:36:11.387328 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.387294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq7c4" event={"ID":"6a22761b-3636-4372-b04f-c95b3e85b058","Type":"ContainerStarted","Data":"d7e9cd1b60a2a4d35b996c4e89408b0cd217b4dbee350c87d34c1b58a38f9d0d"} Jul 03 17:36:11.389324 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.389291 2578 generic.go:356] "Generic (PLEG): container finished" podID="4f5244e6-4dfc-4992-9235-6c0167d269d9" containerID="84027c893750221bdcd37e3ddeea159185699b863182f381cda57a125f2329d7" exitCode=0 Jul 03 17:36:11.389461 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.389402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4r2f" event={"ID":"4f5244e6-4dfc-4992-9235-6c0167d269d9","Type":"ContainerDied","Data":"84027c893750221bdcd37e3ddeea159185699b863182f381cda57a125f2329d7"} Jul 03 17:36:11.391227 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.391203 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54" exitCode=0 Jul 03 17:36:11.391338 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.391291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54"} Jul 03 17:36:11.392859 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.392834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" event={"ID":"80f167ee-7a6a-4875-a269-c2f8a2241ae1","Type":"ContainerStarted","Data":"840af83d265fd257ca4c53a606be2731921e864b348cb7eaa94a03f46374631b"} Jul 03 17:36:11.394673 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.394646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" event={"ID":"09479745-a657-425c-91cd-10945e9cc937","Type":"ContainerStarted","Data":"92d582ee1b285e17ea4964dde51e948886af14025be434140be3478aac6ab203"} Jul 03 17:36:11.394780 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.394691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" event={"ID":"09479745-a657-425c-91cd-10945e9cc937","Type":"ContainerStarted","Data":"d8172d419f0ee0542a6d64d52b32885cd4bd849399631fd303db628ecd197fd0"} Jul 03 17:36:11.394780 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.394727 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:11.458895 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.458839 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" podStartSLOduration=103.458818465 podStartE2EDuration="1m43.458818465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:11.456801473 +0000 UTC m=+104.150898692" watchObservedRunningTime="2026-07-03 17:36:11.458818465 +0000 UTC m=+104.152915665" Jul 03 17:36:11.932657 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:11.932578 2578 scope.go:117] "RemoveContainer" containerID="6d05801f733665300dc54aa6026e325370cb6b760dc004e185acfcfb2d7688a6" Jul 03 17:36:12.406404 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:12.406266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4r2f" event={"ID":"4f5244e6-4dfc-4992-9235-6c0167d269d9","Type":"ContainerStarted","Data":"9082d9b4b95d31b390fcf7f48d42e445d849edd763acc52b98ae5c95905b0bdf"} Jul 03 17:36:12.406404 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:12.406323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4r2f" event={"ID":"4f5244e6-4dfc-4992-9235-6c0167d269d9","Type":"ContainerStarted","Data":"434d1b294be80aa1f1039d297dab9ba4d2b55d12829ab72d11e2037307d89dc7"} Jul 03 17:36:13.371841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.371777 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g4r2f" podStartSLOduration=5.429155459 podStartE2EDuration="7.371754486s" totalImagesPullingTime="1.852773074s" totalInitContainerRuntime="89.825953ms" isStatefulPod=true podCreationTimestamp="2026-07-03 17:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:12.444741425 +0000 UTC m=+105.138838633" watchObservedRunningTime="2026-07-03 17:36:13.371754486 +0000 UTC m=+106.065851683" Jul 03 17:36:13.373430 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.373406 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:13.378069 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.378046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.382088 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.381960 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 17:36:13.382088 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 17:36:13.382088 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xw5mm\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382838 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382843 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382944 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 17:36:13.383130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.382892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 17:36:13.383684 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.383174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 17:36:13.383684 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.383191 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 17:36:13.383684 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.383454 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ku3gd9372966\"" Jul 03 17:36:13.391367 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.391339 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 17:36:13.397230 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.397201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 17:36:13.404619 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.404593 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:13.456762 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.456915 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjsm\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.456915 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.456915 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457028 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457028 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.456983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457098 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457132 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457162 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457202 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457278 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457313 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457313 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457395 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457395 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.457564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.457476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.557976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.558508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjsm\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.558902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.559471 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.559359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.560246 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.560223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.561505 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.561472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.561789 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.561761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.562809 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.562780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.564593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.564545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.565136 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.565109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.567463 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.567291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.567695 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.567651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.567695 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.567677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.569114 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.568931 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.569213 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.569159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.569420 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.569324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.570018 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.569973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.570469 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.570270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.570829 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.570801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.570922 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.570854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjsm\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.571504 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.571480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.689680 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.689475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:13.919033 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:13.918997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:36:13.925304 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:13.925274 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941e4a1d_2e26_4b8d_a95b_8fd8c783d08f.slice/crio-ede1eb1cbd69a75c85d0514e3d83ca978e5ae25bb9e897ffc70f15ebcaa2545b WatchSource:0}: Error finding container ede1eb1cbd69a75c85d0514e3d83ca978e5ae25bb9e897ffc70f15ebcaa2545b: Status 404 returned error can't find the container with id ede1eb1cbd69a75c85d0514e3d83ca978e5ae25bb9e897ffc70f15ebcaa2545b Jul 03 17:36:14.358704 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.357964 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:36:14.421263 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.421215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"14410c181b675df0c98e86f53b26caf755ee70eeed9da5e6edfeb0de9697c28b"} Jul 03 17:36:14.421707 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.421363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"9a4fbbfc019758116de84e972ac144efa197d66393ccb731badccedf2b9fabcf"} Jul 03 17:36:14.421707 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.421444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"6d728e9914f2703d2c53dce83d0b03e30102184d5060ce03d542da4e6629e126"} Jul 03 17:36:14.424053 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.424032 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:36:14.424181 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.424116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" event={"ID":"74895c83-cc2e-44ac-8d1a-c78a37cf66dc","Type":"ContainerStarted","Data":"3b2e652d87777f5f310a9f1750047f5a11540a0db931d1861d4eb7b2dda07157"} Jul 03 17:36:14.424534 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.424511 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:36:14.427430 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.427407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42"} Jul 03 17:36:14.427540 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.427475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38"} Jul 03 17:36:14.427540 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.427520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a"} Jul 03 17:36:14.427666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.427561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491"} Jul 03 17:36:14.427666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.427598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd"} Jul 03 17:36:14.428901 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.428879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" event={"ID":"80f167ee-7a6a-4875-a269-c2f8a2241ae1","Type":"ContainerStarted","Data":"63805e457454c47858960f96c7329caba8c068daa45a3ea266e8b01a4f8c52f9"} Jul 03 17:36:14.430387 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.430356 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" exitCode=0 Jul 03 17:36:14.430486 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.430401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} Jul 03 17:36:14.430486 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.430458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"ede1eb1cbd69a75c85d0514e3d83ca978e5ae25bb9e897ffc70f15ebcaa2545b"} Jul 03 17:36:14.432219 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.432199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq7c4" event={"ID":"6a22761b-3636-4372-b04f-c95b3e85b058","Type":"ContainerStarted","Data":"8e7fcd9891e6204994dc832a339c79b7c3c5d1b979b0d506d5fbca0f031bd2da"} Jul 03 17:36:14.432301 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.432241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq7c4" event={"ID":"6a22761b-3636-4372-b04f-c95b3e85b058","Type":"ContainerStarted","Data":"b0745d6ce71955cb19db694ac5403f77202ae538de0281556a14f367eff86c2f"} Jul 03 17:36:14.432352 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.432342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bq7c4" Jul 03 17:36:14.462412 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.462351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" podStartSLOduration=54.160555 podStartE2EDuration="56.462335963s" totalImagesPullingTime="2.301780963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:14.462105748 +0000 UTC m=+107.156202947" watchObservedRunningTime="2026-07-03 17:36:14.462335963 +0000 UTC m=+107.156433162" Jul 03 17:36:14.543408 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.543345 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bq7c4" podStartSLOduration=66.553445848 podStartE2EDuration="1m9.543330265s" totalImagesPullingTime="2.989884417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:14.54112535 +0000 UTC m=+107.235222567" watchObservedRunningTime="2026-07-03 17:36:14.543330265 +0000 UTC m=+107.237427461" Jul 03 17:36:14.679510 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:14.679240 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" podStartSLOduration=2.561701558 podStartE2EDuration="4.679216643s" totalImagesPullingTime="2.117515085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:14.604405793 +0000 UTC m=+107.298502990" watchObservedRunningTime="2026-07-03 17:36:14.679216643 +0000 UTC m=+107.373313840" Jul 03 17:36:15.253121 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.253090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-rv9c4" Jul 03 17:36:15.441661 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.441618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"60045b701843750b8ed4107a11bbb1f1cb725b9b0f52140fa8fccb6fba358a9c"} Jul 03 17:36:15.442170 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.441708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"a8f5287861f33f4a352950ff2d125355965b15665abfebb362c708edfd34821e"} Jul 03 17:36:15.442170 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.441747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" event={"ID":"f518660b-5e74-4a07-96ce-3cb1f695a57e","Type":"ContainerStarted","Data":"c027e51ffc8a648dca7ac6aae8d11de4a243aad54af6bce6ce3552e75995a393"} Jul 03 17:36:15.442170 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.441791 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:15.445180 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.445143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerStarted","Data":"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787"} Jul 03 17:36:15.594146 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.594043 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" podStartSLOduration=3.6518625350000002 podStartE2EDuration="7.594024763s" totalImagesPullingTime="3.942162228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:15.584713492 +0000 UTC m=+108.278810689" watchObservedRunningTime="2026-07-03 17:36:15.594024763 +0000 UTC m=+108.288121959" Jul 03 17:36:15.671909 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:15.671847 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.113777537 podStartE2EDuration="8.671830165s" totalImagesPullingTime="4.543276059s" totalInitContainerRuntime="14.776569ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:15.665235294 +0000 UTC m=+108.359332492" watchObservedRunningTime="2026-07-03 17:36:15.671830165 +0000 UTC m=+108.365927361" Jul 03 17:36:18.465535 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} Jul 03 17:36:18.465980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} Jul 03 17:36:18.465980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} Jul 03 17:36:18.465980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} Jul 03 17:36:18.465980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} Jul 03 17:36:18.465980 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.465734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerStarted","Data":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} Jul 03 17:36:18.513087 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.513026 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.525300945 podStartE2EDuration="5.513004946s" totalImagesPullingTime="2.969014845s" totalInitContainerRuntime="18.689156ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:18.510033919 +0000 UTC m=+111.204131116" watchObservedRunningTime="2026-07-03 17:36:18.513004946 +0000 UTC m=+111.207102143" Jul 03 17:36:18.690792 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:18.690750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:36:21.457329 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:21.457303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6dc8f885b7-w7nml" Jul 03 17:36:24.447949 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:24.447915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bq7c4" Jul 03 17:36:31.194151 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:31.194095 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:31.194587 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:31.194214 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:34.364505 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:34.364477 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:37.594265 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:37.594226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:36:37.596552 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:37.596529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d41ac2-bf75-46e8-b376-57d526a52d19-metrics-certs\") pod \"network-metrics-daemon-2ng2c\" (UID: \"d6d41ac2-bf75-46e8-b376-57d526a52d19\") " pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:36:37.862253 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:37.862179 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vrbl\"" Jul 03 17:36:37.869874 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:37.869847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ng2c" Jul 03 17:36:38.018924 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:38.018897 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ng2c"] Jul 03 17:36:38.021482 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:36:38.021442 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d41ac2_bf75_46e8_b376_57d526a52d19.slice/crio-982a9f0cb2241f3e02b1dce2065286240877df4a016b1aa78a7aa89b5ac63b2f WatchSource:0}: Error finding container 982a9f0cb2241f3e02b1dce2065286240877df4a016b1aa78a7aa89b5ac63b2f: Status 404 returned error can't find the container with id 982a9f0cb2241f3e02b1dce2065286240877df4a016b1aa78a7aa89b5ac63b2f Jul 03 17:36:38.546095 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:38.546049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ng2c" event={"ID":"d6d41ac2-bf75-46e8-b376-57d526a52d19","Type":"ContainerStarted","Data":"982a9f0cb2241f3e02b1dce2065286240877df4a016b1aa78a7aa89b5ac63b2f"} Jul 03 17:36:39.382209 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.382160 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" podUID="09479745-a657-425c-91cd-10945e9cc937" containerName="registry" containerID="cri-o://92d582ee1b285e17ea4964dde51e948886af14025be434140be3478aac6ab203" gracePeriod=30 Jul 03 17:36:39.552848 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.552805 2578 generic.go:356] "Generic (PLEG): container finished" podID="09479745-a657-425c-91cd-10945e9cc937" containerID="92d582ee1b285e17ea4964dde51e948886af14025be434140be3478aac6ab203" exitCode=0 Jul 03 17:36:39.553023 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.552875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" event={"ID":"09479745-a657-425c-91cd-10945e9cc937","Type":"ContainerDied","Data":"92d582ee1b285e17ea4964dde51e948886af14025be434140be3478aac6ab203"} Jul 03 17:36:39.554991 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.554959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ng2c" event={"ID":"d6d41ac2-bf75-46e8-b376-57d526a52d19","Type":"ContainerStarted","Data":"8a40043bf510f54ad6918a54629bacdebde514521cd4c03c2ac1621513210885"} Jul 03 17:36:39.555117 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.555021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ng2c" event={"ID":"d6d41ac2-bf75-46e8-b376-57d526a52d19","Type":"ContainerStarted","Data":"39e922d90b4556e742aab1c4ad9568faa87de624b7a5f2a5f2346fc0459ec967"} Jul 03 17:36:39.605565 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.605511 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2ng2c" podStartSLOduration=130.707276528 podStartE2EDuration="2m11.605494809s" totalImagesPullingTime="898.218281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:36:39.604614087 +0000 UTC m=+132.298711283" watchObservedRunningTime="2026-07-03 17:36:39.605494809 +0000 UTC m=+132.299592006" Jul 03 17:36:39.644242 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.644172 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:39.812453 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx4j5\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812521 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812550 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812576 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812637 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812609 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812899 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812640 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.812899 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812673 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration\") pod \"09479745-a657-425c-91cd-10945e9cc937\" (UID: \"09479745-a657-425c-91cd-10945e9cc937\") " Jul 03 17:36:39.813010 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.812981 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:36:39.813346 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.813312 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:36:39.815200 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.815167 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5" (OuterVolumeSpecName: "kube-api-access-cx4j5") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "kube-api-access-cx4j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:36:39.815316 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.815219 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:36:39.815413 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.815359 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:36:39.815463 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.815415 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:36:39.815463 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.815443 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:36:39.821067 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.821041 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "09479745-a657-425c-91cd-10945e9cc937" (UID: "09479745-a657-425c-91cd-10945e9cc937"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914113 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-bound-sa-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914147 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-trusted-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914156 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-installation-pull-secrets\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914165 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09479745-a657-425c-91cd-10945e9cc937-registry-certificates\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914174 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-registry-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914182 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09479745-a657-425c-91cd-10945e9cc937-image-registry-private-configuration\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914192 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09479745-a657-425c-91cd-10945e9cc937-ca-trust-extracted\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:39.914204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:39.914200 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx4j5\" (UniqueName: \"kubernetes.io/projected/09479745-a657-425c-91cd-10945e9cc937-kube-api-access-cx4j5\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:36:40.563666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:40.563636 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" Jul 03 17:36:40.564719 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:40.563625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84d54b67bc-pjp9d" event={"ID":"09479745-a657-425c-91cd-10945e9cc937","Type":"ContainerDied","Data":"d8172d419f0ee0542a6d64d52b32885cd4bd849399631fd303db628ecd197fd0"} Jul 03 17:36:40.564870 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:40.564852 2578 scope.go:117] "RemoveContainer" containerID="92d582ee1b285e17ea4964dde51e948886af14025be434140be3478aac6ab203" Jul 03 17:36:40.587539 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:40.587512 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:36:40.597641 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:40.597611 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84d54b67bc-pjp9d"] Jul 03 17:36:41.938475 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:41.937859 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09479745-a657-425c-91cd-10945e9cc937" path="/var/lib/kubelet/pods/09479745-a657-425c-91cd-10945e9cc937/volumes" Jul 03 17:36:51.199862 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:51.199826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:36:51.203759 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:36:51.203738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55579ccd4b-s7kx4" Jul 03 17:37:13.690174 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:13.690133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:13.706440 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:13.706413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:13.721826 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:13.721801 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:27.402536 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402458 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:27.402922 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402780 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="alertmanager" containerID="cri-o://d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" gracePeriod=120 Jul 03 17:37:27.402922 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402851 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-metric" containerID="cri-o://4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" gracePeriod=120 Jul 03 17:37:27.402922 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402866 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-web" containerID="cri-o://fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" gracePeriod=120 Jul 03 17:37:27.403092 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402914 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="prom-label-proxy" containerID="cri-o://06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" gracePeriod=120 Jul 03 17:37:27.403092 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402941 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="config-reloader" containerID="cri-o://67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" gracePeriod=120 Jul 03 17:37:27.403092 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.402926 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy" containerID="cri-o://347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" gracePeriod=120 Jul 03 17:37:27.762054 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762022 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" exitCode=0 Jul 03 17:37:27.762054 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762047 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" exitCode=0 Jul 03 17:37:27.762054 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762054 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" exitCode=0 Jul 03 17:37:27.762054 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762059 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" exitCode=0 Jul 03 17:37:27.762296 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787"} Jul 03 17:37:27.762296 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38"} Jul 03 17:37:27.762296 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491"} Jul 03 17:37:27.762296 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:27.762201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd"} Jul 03 17:37:28.750734 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.750676 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:28.769089 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769054 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" exitCode=0 Jul 03 17:37:28.769089 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769080 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerID="fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" exitCode=0 Jul 03 17:37:28.769287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42"} Jul 03 17:37:28.769287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769123 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:28.769287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a"} Jul 03 17:37:28.769287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfa87b1c-31af-4ac0-96ba-47dfb605ae78","Type":"ContainerDied","Data":"b6423e18e75009d577ae746cca7ad9d9deddd50796d32dc1d76208f6bbbd4c47"} Jul 03 17:37:28.769287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.769261 2578 scope.go:117] "RemoveContainer" containerID="06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" Jul 03 17:37:28.776689 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.776673 2578 scope.go:117] "RemoveContainer" containerID="4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" Jul 03 17:37:28.785821 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.784863 2578 scope.go:117] "RemoveContainer" containerID="347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" Jul 03 17:37:28.793411 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.793348 2578 scope.go:117] "RemoveContainer" containerID="fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" Jul 03 17:37:28.801989 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.801966 2578 scope.go:117] "RemoveContainer" containerID="67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" Jul 03 17:37:28.809497 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.809475 2578 scope.go:117] "RemoveContainer" containerID="d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" Jul 03 17:37:28.816698 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.816659 2578 scope.go:117] "RemoveContainer" containerID="9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54" Jul 03 17:37:28.824740 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.824718 2578 scope.go:117] "RemoveContainer" containerID="06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" Jul 03 17:37:28.825009 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.824989 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787\": container with ID starting with 06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787 not found: ID does not exist" containerID="06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" Jul 03 17:37:28.825081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825018 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787"} err="failed to get container status \"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787\": rpc error: code = NotFound desc = could not find container \"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787\": container with ID starting with 06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787 not found: ID does not exist" Jul 03 17:37:28.825081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825059 2578 scope.go:117] "RemoveContainer" containerID="4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" Jul 03 17:37:28.825327 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.825308 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42\": container with ID starting with 4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42 not found: ID does not exist" containerID="4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" Jul 03 17:37:28.825414 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825333 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42"} err="failed to get container status \"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42\": rpc error: code = NotFound desc = could not find container \"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42\": container with ID starting with 4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42 not found: ID does not exist" Jul 03 17:37:28.825414 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825351 2578 scope.go:117] "RemoveContainer" containerID="347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" Jul 03 17:37:28.825632 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.825613 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38\": container with ID starting with 347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38 not found: ID does not exist" containerID="347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" Jul 03 17:37:28.825689 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825636 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38"} err="failed to get container status \"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38\": rpc error: code = NotFound desc = could not find container \"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38\": container with ID starting with 347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38 not found: ID does not exist" Jul 03 17:37:28.825689 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825649 2578 scope.go:117] "RemoveContainer" containerID="fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" Jul 03 17:37:28.825905 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.825884 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a\": container with ID starting with fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a not found: ID does not exist" containerID="fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" Jul 03 17:37:28.825963 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825912 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a"} err="failed to get container status \"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a\": rpc error: code = NotFound desc = could not find container \"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a\": container with ID starting with fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a not found: ID does not exist" Jul 03 17:37:28.825963 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.825928 2578 scope.go:117] "RemoveContainer" containerID="67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" Jul 03 17:37:28.826143 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.826128 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491\": container with ID starting with 67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491 not found: ID does not exist" containerID="67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" Jul 03 17:37:28.826199 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826146 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491"} err="failed to get container status \"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491\": rpc error: code = NotFound desc = could not find container \"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491\": container with ID starting with 67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491 not found: ID does not exist" Jul 03 17:37:28.826199 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826159 2578 scope.go:117] "RemoveContainer" containerID="d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" Jul 03 17:37:28.826363 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.826349 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd\": container with ID starting with d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd not found: ID does not exist" containerID="d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" Jul 03 17:37:28.826467 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826365 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd"} err="failed to get container status \"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd\": rpc error: code = NotFound desc = could not find container \"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd\": container with ID starting with d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd not found: ID does not exist" Jul 03 17:37:28.826467 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826393 2578 scope.go:117] "RemoveContainer" containerID="9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54" Jul 03 17:37:28.826570 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:28.826561 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54\": container with ID starting with 9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54 not found: ID does not exist" containerID="9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54" Jul 03 17:37:28.826624 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826577 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54"} err="failed to get container status \"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54\": rpc error: code = NotFound desc = could not find container \"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54\": container with ID starting with 9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54 not found: ID does not exist" Jul 03 17:37:28.826624 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826588 2578 scope.go:117] "RemoveContainer" containerID="06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787" Jul 03 17:37:28.826831 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826811 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787"} err="failed to get container status \"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787\": rpc error: code = NotFound desc = could not find container \"06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787\": container with ID starting with 06f070c6d35f6b8355a54a6197d2653a234cffc46e78be8714e03b4fceae2787 not found: ID does not exist" Jul 03 17:37:28.826898 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.826832 2578 scope.go:117] "RemoveContainer" containerID="4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42" Jul 03 17:37:28.827075 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827058 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42"} err="failed to get container status \"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42\": rpc error: code = NotFound desc = could not find container \"4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42\": container with ID starting with 4d3e2d20f00672d4d6165e375d23be7c5ae488d28667b3ba64aaef63a2acad42 not found: ID does not exist" Jul 03 17:37:28.827138 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827075 2578 scope.go:117] "RemoveContainer" containerID="347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38" Jul 03 17:37:28.827243 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827226 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38"} err="failed to get container status \"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38\": rpc error: code = NotFound desc = could not find container \"347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38\": container with ID starting with 347bdb2453f11368b321da90e462569b028c107d485e22d72266a5838743cf38 not found: ID does not exist" Jul 03 17:37:28.827305 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827244 2578 scope.go:117] "RemoveContainer" containerID="fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a" Jul 03 17:37:28.827487 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827456 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a"} err="failed to get container status \"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a\": rpc error: code = NotFound desc = could not find container \"fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a\": container with ID starting with fb4b4352f09fd87c239443a318fa95689a2bd32ec0f5f8df721f862c97d0b78a not found: ID does not exist" Jul 03 17:37:28.827487 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827479 2578 scope.go:117] "RemoveContainer" containerID="67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491" Jul 03 17:37:28.827736 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827719 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491"} err="failed to get container status \"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491\": rpc error: code = NotFound desc = could not find container \"67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491\": container with ID starting with 67d83529e8a489c28624d21832dc84c46ff49d3581218ab4adc75670d328e491 not found: ID does not exist" Jul 03 17:37:28.827779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827739 2578 scope.go:117] "RemoveContainer" containerID="d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd" Jul 03 17:37:28.827955 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827940 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd"} err="failed to get container status \"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd\": rpc error: code = NotFound desc = could not find container \"d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd\": container with ID starting with d4a56e3f03060af077e2f525300717cec8524c97367ff0ecea385f73e974dfbd not found: ID does not exist" Jul 03 17:37:28.827955 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.827955 2578 scope.go:117] "RemoveContainer" containerID="9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54" Jul 03 17:37:28.828194 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.828176 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54"} err="failed to get container status \"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54\": rpc error: code = NotFound desc = could not find container \"9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54\": container with ID starting with 9287e3ef02c3b05e552a2ec3839c2e1315628876262a9bfcdc156cb0cb444d54 not found: ID does not exist" Jul 03 17:37:28.854027 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854000 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854143 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854039 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854143 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854143 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854117 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854143 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854142 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854170 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854199 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854265 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854297 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854353 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854339 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwwzk\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854625 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854367 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854625 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854442 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854625 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out\") pod \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\" (UID: \"dfa87b1c-31af-4ac0-96ba-47dfb605ae78\") " Jul 03 17:37:28.854769 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854650 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:28.854769 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854687 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:28.854769 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854752 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-metrics-client-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.854931 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.854905 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:28.857503 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.857461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out" (OuterVolumeSpecName: "config-out") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:28.857624 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.857565 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.857718 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.857686 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.857831 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.857798 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk" (OuterVolumeSpecName: "kube-api-access-gwwzk") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "kube-api-access-gwwzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:28.857912 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.857885 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.858118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.858089 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:28.858263 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.858246 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.858930 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.858913 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume" (OuterVolumeSpecName: "config-volume") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.861562 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.861539 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.867915 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.867894 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config" (OuterVolumeSpecName: "web-config") pod "dfa87b1c-31af-4ac0-96ba-47dfb605ae78" (UID: "dfa87b1c-31af-4ac0-96ba-47dfb605ae78"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:28.955188 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955149 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-main-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955188 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955181 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-out\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955188 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955191 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-cluster-tls-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955203 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955214 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-web-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955222 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955230 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-main-db\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955239 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955248 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955257 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-config-volume\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955265 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwwzk\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-kube-api-access-gwwzk\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:28.955457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:28.955273 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfa87b1c-31af-4ac0-96ba-47dfb605ae78-tls-assets\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:29.099647 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.099611 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:29.108569 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.108542 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:29.152551 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152517 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:29.152875 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152859 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-metric" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152879 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-metric" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152891 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-web" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152896 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-web" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152907 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="init-config-reloader" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152912 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="init-config-reloader" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152919 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="config-reloader" Jul 03 17:37:29.152925 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152924 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="config-reloader" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152931 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="alertmanager" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152936 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="alertmanager" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152952 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="prom-label-proxy" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152961 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="prom-label-proxy" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152973 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09479745-a657-425c-91cd-10945e9cc937" containerName="registry" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152979 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="09479745-a657-425c-91cd-10945e9cc937" containerName="registry" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152987 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.152992 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153047 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="config-reloader" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153057 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-web" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153062 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="alertmanager" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153069 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="prom-label-proxy" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153074 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy-metric" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153080 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="09479745-a657-425c-91cd-10945e9cc937" containerName="registry" Jul 03 17:37:29.153120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.153085 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" containerName="kube-rbac-proxy" Jul 03 17:37:29.158506 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.158489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.161004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.160979 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 17:37:29.161004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.160994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 17:37:29.161184 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.160993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 17:37:29.161184 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.161106 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 17:37:29.161320 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.161305 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 17:37:29.161384 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.161350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 17:37:29.161885 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.161863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gbkvq\"" Jul 03 17:37:29.161885 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.161869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 17:37:29.162062 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.162019 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 17:37:29.168877 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.168858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 17:37:29.173662 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.173639 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:29.257581 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257581 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h27mv\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-kube-api-access-h27mv\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-config-out\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.257799 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.258011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.258011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-web-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.258011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.258011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.258011 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.257919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358601 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-web-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358601 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358601 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358869 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358869 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358869 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.358869 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359078 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359078 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.358994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h27mv\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-kube-api-access-h27mv\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359078 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359078 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-config-out\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359280 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359280 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359542 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.359908 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.359873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.360022 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.360006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e64addd9-5396-44ce-8999-619ccb62cc17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.361688 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.361659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.361789 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.361705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-web-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.361789 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.361746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.362431 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.362406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-config-volume\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.362530 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.362479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.362530 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.362509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.362610 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.362595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.362841 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.362821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e64addd9-5396-44ce-8999-619ccb62cc17-config-out\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.363244 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.363229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e64addd9-5396-44ce-8999-619ccb62cc17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.370448 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.370428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h27mv\" (UniqueName: \"kubernetes.io/projected/e64addd9-5396-44ce-8999-619ccb62cc17-kube-api-access-h27mv\") pod \"alertmanager-main-0\" (UID: \"e64addd9-5396-44ce-8999-619ccb62cc17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.468279 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.468245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 17:37:29.613643 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.613616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 17:37:29.615538 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:37:29.615510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64addd9_5396_44ce_8999_619ccb62cc17.slice/crio-390989eca60e54fd70221d717ad43faf87cec227dba3812115c2b81ba567bb45 WatchSource:0}: Error finding container 390989eca60e54fd70221d717ad43faf87cec227dba3812115c2b81ba567bb45: Status 404 returned error can't find the container with id 390989eca60e54fd70221d717ad43faf87cec227dba3812115c2b81ba567bb45 Jul 03 17:37:29.774029 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.773995 2578 generic.go:356] "Generic (PLEG): container finished" podID="e64addd9-5396-44ce-8999-619ccb62cc17" containerID="ff7fbe0a4836ea095042f372d853339ddd3272737d54d5f6f6a88fe40c63fef5" exitCode=0 Jul 03 17:37:29.774468 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.774090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerDied","Data":"ff7fbe0a4836ea095042f372d853339ddd3272737d54d5f6f6a88fe40c63fef5"} Jul 03 17:37:29.774468 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.774180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"390989eca60e54fd70221d717ad43faf87cec227dba3812115c2b81ba567bb45"} Jul 03 17:37:29.937622 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:29.937597 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa87b1c-31af-4ac0-96ba-47dfb605ae78" path="/var/lib/kubelet/pods/dfa87b1c-31af-4ac0-96ba-47dfb605ae78/volumes" Jul 03 17:37:30.787923 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.787836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"f731d714cc4d8881be5590e331c86883672fe713ea0e4d0dec33e30faa8b719d"} Jul 03 17:37:30.788269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.787948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"d9a08c72e51ce90191db9a806d5ef3cd7ed983b895731aa8b22b615680019a31"} Jul 03 17:37:30.788269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.787991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"f5cf85e4d7c0dcd00d4aa563810a330a89ef3826e5a84e38a68ff34e11939e3c"} Jul 03 17:37:30.788269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.788028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"a2e751ba347957a554f0a5f34930b323291ad41523a9f2947a937499a0b19b9e"} Jul 03 17:37:30.788269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.788062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"17f04542ffaef87f50592767d4f58c3cc337a4e7f183bf2208743c4fb4ea289a"} Jul 03 17:37:30.788269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.788099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e64addd9-5396-44ce-8999-619ccb62cc17","Type":"ContainerStarted","Data":"4c9c114a8ad425530999a55ba8d2b686438b391ecb4339cf5a61bcf2d472c3d5"} Jul 03 17:37:30.826319 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:30.826237 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.8108110320000002 podStartE2EDuration="1.826216541s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.405509ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:37:30.825216277 +0000 UTC m=+183.519313478" watchObservedRunningTime="2026-07-03 17:37:30.826216541 +0000 UTC m=+183.520313738" Jul 03 17:37:31.478757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.478710 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb"] Jul 03 17:37:31.482350 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.482331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.485575 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.485554 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 03 17:37:31.485790 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.485775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 03 17:37:31.486300 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.486279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 03 17:37:31.486462 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.486335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 03 17:37:31.486524 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.486479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j268x\"" Jul 03 17:37:31.486567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.486555 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 03 17:37:31.493502 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.493484 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 03 17:37:31.498616 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.498594 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb"] Jul 03 17:37:31.681306 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-serving-certs-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681306 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-metrics-client-ca\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-federate-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.681566 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.681521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgccj\" (UniqueName: \"kubernetes.io/projected/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-kube-api-access-wgccj\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.781937 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.781836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.781937 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.781899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-federate-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.781946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.781979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgccj\" (UniqueName: \"kubernetes.io/projected/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-kube-api-access-wgccj\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-serving-certs-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782173 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-metrics-client-ca\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.782923 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782892 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-metrics-client-ca\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.783030 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.782889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.783128 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.783102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-serving-certs-ca-bundle\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.784690 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.784661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.784690 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.784683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-federate-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.784851 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.784679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.784851 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.784809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-telemeter-client-tls\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.799321 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.799300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgccj\" (UniqueName: \"kubernetes.io/projected/fc15619d-5f2c-421c-9d4d-2eab30bbfa86-kube-api-access-wgccj\") pod \"telemeter-client-5b5db9f6f7-8rltb\" (UID: \"fc15619d-5f2c-421c-9d4d-2eab30bbfa86\") " pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:31.812513 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812483 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:31.812813 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812775 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" gracePeriod=600 Jul 03 17:37:31.812813 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812808 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-web" containerID="cri-o://f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" gracePeriod=600 Jul 03 17:37:31.813005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812845 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="thanos-sidecar" containerID="cri-o://0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" gracePeriod=600 Jul 03 17:37:31.813005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812780 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy" containerID="cri-o://c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" gracePeriod=600 Jul 03 17:37:31.813005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812914 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="prometheus" containerID="cri-o://5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" gracePeriod=600 Jul 03 17:37:31.813005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:31.812871 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="config-reloader" containerID="cri-o://f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" gracePeriod=600 Jul 03 17:37:32.047918 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.047891 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.084663 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084628 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.084887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084704 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.084887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084733 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.084887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084773 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.084887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084808 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.084887 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084841 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084892 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084917 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084953 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.084989 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fjsm\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085031 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085057 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085153 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085154 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085193 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085219 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085250 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085278 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085274 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.085593 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085334 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.085882 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085669 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.085882 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085693 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.085976 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085895 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.086028 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.085999 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.086717 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.086685 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.087246 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.087214 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.087363 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.087343 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:32.087746 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.087408 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.087746 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.087645 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.087746 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.087704 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.089031 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.088984 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 17:37:32.089616 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.089583 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config" (OuterVolumeSpecName: "config") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.089780 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.089754 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm" (OuterVolumeSpecName: "kube-api-access-5fjsm") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "kube-api-access-5fjsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:32.090476 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.090436 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 17:37:32.091564 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.091534 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.091706 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.091686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" Jul 03 17:37:32.091790 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.091720 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.092210 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.092176 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.092874 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.092836 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.102984 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.102941 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config" (OuterVolumeSpecName: "web-config") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 17:37:32.186494 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186433 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out\") pod \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\" (UID: \"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f\") " Jul 03 17:37:32.186718 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186699 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.186779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186727 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fjsm\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-kube-api-access-5fjsm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.186779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186742 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-web-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.186779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186757 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-kube-rbac-proxy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.186779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186769 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-grpc-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.186779 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186782 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186791 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-tls-assets\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186800 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186807 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186816 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186825 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-db\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186845 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186858 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-metrics-client-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186866 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186876 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186884 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-configmap-metrics-client-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.187020 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.186893 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.189148 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.189117 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out" (OuterVolumeSpecName: "config-out") pod "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" (UID: "941e4a1d-2e26-4b8d-a95b-8fd8c783d08f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 17:37:32.235986 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.235954 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb"] Jul 03 17:37:32.239685 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:37:32.239653 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc15619d_5f2c_421c_9d4d_2eab30bbfa86.slice/crio-f1d24bf56829997c03aa081d8f01bb417e05c99415dbe49c3f815d66e9cc2985 WatchSource:0}: Error finding container f1d24bf56829997c03aa081d8f01bb417e05c99415dbe49c3f815d66e9cc2985: Status 404 returned error can't find the container with id f1d24bf56829997c03aa081d8f01bb417e05c99415dbe49c3f815d66e9cc2985 Jul 03 17:37:32.288016 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.287991 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f-config-out\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\"" Jul 03 17:37:32.801029 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.800994 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" exitCode=0 Jul 03 17:37:32.801029 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801027 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" exitCode=0 Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801038 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" exitCode=0 Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801047 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" exitCode=0 Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801056 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" exitCode=0 Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801065 2578 generic.go:356] "Generic (PLEG): container finished" podID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" exitCode=0 Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801089 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801341 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} Jul 03 17:37:32.801480 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} Jul 03 17:37:32.801955 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.801497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"941e4a1d-2e26-4b8d-a95b-8fd8c783d08f","Type":"ContainerDied","Data":"ede1eb1cbd69a75c85d0514e3d83ca978e5ae25bb9e897ffc70f15ebcaa2545b"} Jul 03 17:37:32.802640 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.802615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" event={"ID":"fc15619d-5f2c-421c-9d4d-2eab30bbfa86","Type":"ContainerStarted","Data":"f1d24bf56829997c03aa081d8f01bb417e05c99415dbe49c3f815d66e9cc2985"} Jul 03 17:37:32.813087 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.812888 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.822687 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.822666 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.829884 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.829859 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.831960 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.831902 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:32.855723 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.855696 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:32.858360 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.858343 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.866055 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.866036 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.875205 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.874864 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.876751 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.876721 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877146 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="prometheus" Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877168 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="prometheus" Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877180 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="config-reloader" Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877189 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="config-reloader" Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877205 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:32.877212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877214 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877228 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-web" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877235 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-web" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877248 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877256 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877270 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="init-config-reloader" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877280 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="init-config-reloader" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877296 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="thanos-sidecar" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877303 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="thanos-sidecar" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877361 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877392 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-web" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877403 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="config-reloader" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877410 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="thanos-sidecar" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877415 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="prometheus" Jul 03 17:37:32.877465 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.877420 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" containerName="kube-rbac-proxy-thanos" Jul 03 17:37:32.882745 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.882725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.884043 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.883619 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.884043 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.884061 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.884228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884094 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.884228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884120 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.884437 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.884403 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.884558 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884435 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.884558 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884458 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.884765 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.884742 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.884828 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884773 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.884828 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.884790 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.885047 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.885026 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.885112 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885057 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.885112 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885080 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.885490 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.885465 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.885582 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885493 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.885582 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885513 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885814 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xw5mm\"" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.885822 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885935 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885939 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885960 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.886081 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.885980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886198 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886555 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ku3gd9372966\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: E0703 17:37:32.886624 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886648 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886668 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 03 17:37:32.887120 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.886859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 03 17:37:32.887584 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 03 17:37:32.887584 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887263 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.887584 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887288 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.887738 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887693 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.887738 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887714 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.888005 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.887978 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.888086 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.888005 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.888307 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.888276 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.888307 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.888306 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.889152 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889054 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.889152 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889081 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.889468 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889239 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 03 17:37:32.889546 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889475 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.889546 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889500 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.889874 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889846 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.889874 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.889872 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.890287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890246 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.890287 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890272 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.890560 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890533 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.890646 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890562 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.890914 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890889 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.890914 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.890918 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.891264 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891235 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.891264 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891258 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.891536 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891508 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.891626 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891538 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.891814 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891786 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.891897 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.891814 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.892325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892159 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.892325 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892184 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rclbp\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-kube-api-access-rclbp\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.893629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.892985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.893016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.893053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.893662 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.894492 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.893690 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.894873 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.894540 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.894873 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.894568 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.895478 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.895224 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 03 17:37:32.895562 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.895490 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.895562 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.895517 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.895917 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.895894 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.895917 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.895918 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.896196 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896175 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.896196 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896196 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.896537 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896496 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.896537 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896525 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.896776 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896756 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.896844 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.896777 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.897028 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897001 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.897028 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897027 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.897306 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897282 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.897388 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897310 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.897704 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897667 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.897848 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.897705 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.898061 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.898037 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.898139 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.898062 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.899900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.899818 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.899900 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.899847 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.900248 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900170 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.900248 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900197 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.900712 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900650 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.900712 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900678 2578 scope.go:117] "RemoveContainer" containerID="fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7" Jul 03 17:37:32.900954 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900899 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7"} err="failed to get container status \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": rpc error: code = NotFound desc = could not find container \"fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7\": container with ID starting with fd08ae38d770d16c437b4cb9b5b1913f817bb858f40cf4782c1761f98d8a64e7 not found: ID does not exist" Jul 03 17:37:32.900954 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.900922 2578 scope.go:117] "RemoveContainer" containerID="c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c" Jul 03 17:37:32.901265 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901205 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c"} err="failed to get container status \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": rpc error: code = NotFound desc = could not find container \"c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c\": container with ID starting with c67b90862ee5e0266cd62b267f12b3a7fa137c4f72406b430361581db0ad6c4c not found: ID does not exist" Jul 03 17:37:32.901265 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901237 2578 scope.go:117] "RemoveContainer" containerID="f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a" Jul 03 17:37:32.901576 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901554 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a"} err="failed to get container status \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": rpc error: code = NotFound desc = could not find container \"f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a\": container with ID starting with f480d436d1da232863abbfde7baaf7fc8fcf90264606dbab5c0d8094487ce00a not found: ID does not exist" Jul 03 17:37:32.901676 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901577 2578 scope.go:117] "RemoveContainer" containerID="0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4" Jul 03 17:37:32.901883 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901857 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4"} err="failed to get container status \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": rpc error: code = NotFound desc = could not find container \"0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4\": container with ID starting with 0eee0464b5deeefed0eb9f0c43fc3689e4da51cf97ffa7aa42370bb0e589b6d4 not found: ID does not exist" Jul 03 17:37:32.901952 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.901885 2578 scope.go:117] "RemoveContainer" containerID="f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea" Jul 03 17:37:32.902144 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902120 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea"} err="failed to get container status \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": rpc error: code = NotFound desc = could not find container \"f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea\": container with ID starting with f7b60c2aa84f36358f0fcd27eeb9867420a51b43b65c23061648975357ff16ea not found: ID does not exist" Jul 03 17:37:32.902213 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902146 2578 scope.go:117] "RemoveContainer" containerID="5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf" Jul 03 17:37:32.902213 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902127 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:32.902473 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902447 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf"} err="failed to get container status \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": rpc error: code = NotFound desc = could not find container \"5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf\": container with ID starting with 5062b041ca3f44b3c567ac0d6bb96e96fe2a88104fca5baee9568e617ef656bf not found: ID does not exist" Jul 03 17:37:32.902473 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902472 2578 scope.go:117] "RemoveContainer" containerID="9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb" Jul 03 17:37:32.902751 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.902698 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb"} err="failed to get container status \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": rpc error: code = NotFound desc = could not find container \"9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb\": container with ID starting with 9ee4411b7982b25f49d32607315d8a98a84666b519f5f8db8964b3be111af2eb not found: ID does not exist" Jul 03 17:37:32.993818 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.993818 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rclbp\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-kube-api-access-rclbp\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.993995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.994485 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.995004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.995004 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.994898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.995475 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.995416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.995713 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.995688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.996697 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.996668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.996787 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.996717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.997114 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.997090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.997301 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.997276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.997639 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.997615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.998212 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.998185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.998721 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.998674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999216 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999216 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999414 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1b5980b-4478-496a-923c-14d13007531a-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999496 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999541 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1b5980b-4478-496a-923c-14d13007531a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999598 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:32.999853 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:32.999835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.000364 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.000343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1b5980b-4478-496a-923c-14d13007531a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.002316 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.002299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rclbp\" (UniqueName: \"kubernetes.io/projected/f1b5980b-4478-496a-923c-14d13007531a-kube-api-access-rclbp\") pod \"prometheus-k8s-0\" (UID: \"f1b5980b-4478-496a-923c-14d13007531a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.196568 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.196519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:37:33.356829 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.356794 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 03 17:37:33.360257 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:37:33.360226 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b5980b_4478_496a_923c_14d13007531a.slice/crio-5439ecef18bef9719200f1752d91541cfabfce3a1e8f2f3b9bb8f709fd0a2981 WatchSource:0}: Error finding container 5439ecef18bef9719200f1752d91541cfabfce3a1e8f2f3b9bb8f709fd0a2981: Status 404 returned error can't find the container with id 5439ecef18bef9719200f1752d91541cfabfce3a1e8f2f3b9bb8f709fd0a2981 Jul 03 17:37:33.808666 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.808580 2578 generic.go:356] "Generic (PLEG): container finished" podID="f1b5980b-4478-496a-923c-14d13007531a" containerID="5769156ef34a7d6cf2e3aa88e666bd4e293e82e24903bcf55d465f49014daecf" exitCode=0 Jul 03 17:37:33.809130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.808676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerDied","Data":"5769156ef34a7d6cf2e3aa88e666bd4e293e82e24903bcf55d465f49014daecf"} Jul 03 17:37:33.809130 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.808776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"5439ecef18bef9719200f1752d91541cfabfce3a1e8f2f3b9bb8f709fd0a2981"} Jul 03 17:37:33.938937 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:33.938899 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941e4a1d-2e26-4b8d-a95b-8fd8c783d08f" path="/var/lib/kubelet/pods/941e4a1d-2e26-4b8d-a95b-8fd8c783d08f/volumes" Jul 03 17:37:34.817320 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"8adfbbcee8331d67d89ca711ee4438b91edeb6d97495f34cb4d0e3504c7d2105"} Jul 03 17:37:34.817757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"cc262208d8792089efa6fa5bfb2ef39abe787ce52c8c0b4f50e4b5e3b33ed405"} Jul 03 17:37:34.817757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"0f8b25f00591b4eb56ee73176778d41c43bda0ce358ac5708204b819bc910be4"} Jul 03 17:37:34.817757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"0dbddf8626fa76950662a8d444873fcc60c028229ec6de9950b0c4bfb01a9545"} Jul 03 17:37:34.817757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"e2b0b75e0a9abd4e41a24f2e4a43bec3ab8dea11850aacd08afde7f2d066b4c1"} Jul 03 17:37:34.817757 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.817547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1b5980b-4478-496a-923c-14d13007531a","Type":"ContainerStarted","Data":"2dd1bf3f27dde1a607a29d78635e599f95e8d7148db52db2f4e98c4b1036ab8e"} Jul 03 17:37:34.819520 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.819494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" event={"ID":"fc15619d-5f2c-421c-9d4d-2eab30bbfa86","Type":"ContainerStarted","Data":"1969151208a50129f98b99cd8301456bc4b040ace855bd4c42b90d5419a3ac59"} Jul 03 17:37:34.819648 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.819555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" event={"ID":"fc15619d-5f2c-421c-9d4d-2eab30bbfa86","Type":"ContainerStarted","Data":"8e57b66edf7b074e8ec59dbafe9f276f1db431bf71d3bc86008cf783587604de"} Jul 03 17:37:34.819648 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.819585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" event={"ID":"fc15619d-5f2c-421c-9d4d-2eab30bbfa86","Type":"ContainerStarted","Data":"823dc47acd6805a999799be0ee99b28e322c4ee9349e44f32bfa45a91c9a930c"} Jul 03 17:37:34.850216 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.850153 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.833728754 podStartE2EDuration="2.850132946s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.404192ms" isStatefulPod=false podCreationTimestamp="2026-07-03 17:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:37:34.848611456 +0000 UTC m=+187.542708651" watchObservedRunningTime="2026-07-03 17:37:34.850132946 +0000 UTC m=+187.544230142" Jul 03 17:37:34.874463 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:34.874411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b5db9f6f7-8rltb" podStartSLOduration=1.951184598 podStartE2EDuration="3.874395054s" totalImagesPullingTime="1.923210456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 17:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:37:34.872394868 +0000 UTC m=+187.566492056" watchObservedRunningTime="2026-07-03 17:37:34.874395054 +0000 UTC m=+187.568492247" Jul 03 17:37:38.196940 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:37:38.196880 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:33.197106 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:38:33.197063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:33.212860 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:38:33.212823 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:38:34.086098 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:38:34.086072 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 03 17:39:27.686677 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:27.686643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:39:27.691511 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:27.691483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:39:27.693798 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:27.693764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:39:27.697320 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:27.697295 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 17:39:27.698903 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:27.698881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:39:58.327645 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:58.327615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-trmsv_2d9b3968-372d-46d4-adbf-365b888c1429/global-pull-secret-syncer/0.log" Jul 03 17:39:58.419796 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:58.419771 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-msfb7_83d5f30c-d4a4-47c2-a421-ae29a2b05298/konnectivity-agent/0.log" Jul 03 17:39:58.519571 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:39:58.519539 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-0.ec2.internal_a0854266c70379aa8ce321ab152e516e/haproxy/0.log" Jul 03 17:40:01.929626 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:01.929589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/alertmanager/0.log" Jul 03 17:40:01.958094 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:01.958070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/config-reloader/0.log" Jul 03 17:40:01.984327 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:01.984297 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/kube-rbac-proxy-web/0.log" Jul 03 17:40:02.008241 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.008212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/kube-rbac-proxy/0.log" Jul 03 17:40:02.036127 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.036101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/kube-rbac-proxy-metric/0.log" Jul 03 17:40:02.065201 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.065174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/prom-label-proxy/0.log" Jul 03 17:40:02.086300 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.086280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e64addd9-5396-44ce-8999-619ccb62cc17/init-config-reloader/0.log" Jul 03 17:40:02.155387 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.155346 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n9nt2_499032c0-c26f-4c50-bab9-bc8eca973e83/kube-state-metrics/0.log" Jul 03 17:40:02.177001 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.176972 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n9nt2_499032c0-c26f-4c50-bab9-bc8eca973e83/kube-rbac-proxy-main/0.log" Jul 03 17:40:02.202094 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.202067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n9nt2_499032c0-c26f-4c50-bab9-bc8eca973e83/kube-rbac-proxy-self/0.log" Jul 03 17:40:02.230888 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.230863 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55579ccd4b-s7kx4_80f167ee-7a6a-4875-a269-c2f8a2241ae1/metrics-server/0.log" Jul 03 17:40:02.298609 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.298581 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4r2f_4f5244e6-4dfc-4992-9235-6c0167d269d9/node-exporter/0.log" Jul 03 17:40:02.318457 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.318432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4r2f_4f5244e6-4dfc-4992-9235-6c0167d269d9/kube-rbac-proxy/0.log" Jul 03 17:40:02.340402 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.340361 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4r2f_4f5244e6-4dfc-4992-9235-6c0167d269d9/init-textfile/0.log" Jul 03 17:40:02.613301 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.613272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/prometheus/0.log" Jul 03 17:40:02.633228 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.633201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/config-reloader/0.log" Jul 03 17:40:02.653951 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.653923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/thanos-sidecar/0.log" Jul 03 17:40:02.676592 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.676566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/kube-rbac-proxy-web/0.log" Jul 03 17:40:02.700602 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.700576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/kube-rbac-proxy/0.log" Jul 03 17:40:02.725032 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.725006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/kube-rbac-proxy-thanos/0.log" Jul 03 17:40:02.746520 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.746494 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1b5980b-4478-496a-923c-14d13007531a/init-config-reloader/0.log" Jul 03 17:40:02.839912 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.839835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-vqkwc_bba4f27e-162e-4ac9-af50-7d08f692ce84/prometheus-operator-admission-webhook/0.log" Jul 03 17:40:02.872348 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.872322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b5db9f6f7-8rltb_fc15619d-5f2c-421c-9d4d-2eab30bbfa86/telemeter-client/0.log" Jul 03 17:40:02.900766 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.900740 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b5db9f6f7-8rltb_fc15619d-5f2c-421c-9d4d-2eab30bbfa86/reload/0.log" Jul 03 17:40:02.922012 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.921985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b5db9f6f7-8rltb_fc15619d-5f2c-421c-9d4d-2eab30bbfa86/kube-rbac-proxy/0.log" Jul 03 17:40:02.952269 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.952241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/thanos-query/0.log" Jul 03 17:40:02.974950 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.974922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/kube-rbac-proxy-web/0.log" Jul 03 17:40:02.996952 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:02.996922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/kube-rbac-proxy/0.log" Jul 03 17:40:03.017430 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:03.017398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/prom-label-proxy/0.log" Jul 03 17:40:03.036508 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:03.036479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/kube-rbac-proxy-rules/0.log" Jul 03 17:40:03.064129 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:03.064106 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dc8f885b7-w7nml_f518660b-5e74-4a07-96ce-3cb1f695a57e/kube-rbac-proxy-metrics/0.log" Jul 03 17:40:04.836026 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:04.835997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/2.log" Jul 03 17:40:04.840488 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:04.840466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rv9c4_74895c83-cc2e-44ac-8d1a-c78a37cf66dc/console-operator/3.log" Jul 03 17:40:05.795195 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.795162 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm"] Jul 03 17:40:05.798794 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.798771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.801065 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.801040 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfd2b\"/\"openshift-service-ca.crt\"" Jul 03 17:40:05.801199 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.801066 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfd2b\"/\"kube-root-ca.crt\"" Jul 03 17:40:05.801793 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.801775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bfd2b\"/\"default-dockercfg-m9h2d\"" Jul 03 17:40:05.808424 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.808399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm"] Jul 03 17:40:05.887846 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.887806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-sys\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.888237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.887853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-podres\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.888237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.887941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkw98\" (UniqueName: \"kubernetes.io/projected/8db0d639-b1e3-498f-a131-73e55c2ff18b-kube-api-access-zkw98\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.888237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.888001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-lib-modules\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.888237 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.888057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-proc\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988603 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-sys\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-podres\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkw98\" (UniqueName: \"kubernetes.io/projected/8db0d639-b1e3-498f-a131-73e55c2ff18b-kube-api-access-zkw98\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-lib-modules\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-sys\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-proc\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.988781 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-proc\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.989009 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-podres\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.989009 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.988865 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8db0d639-b1e3-498f-a131-73e55c2ff18b-lib-modules\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:05.997148 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:05.997122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkw98\" (UniqueName: \"kubernetes.io/projected/8db0d639-b1e3-498f-a131-73e55c2ff18b-kube-api-access-zkw98\") pod \"perf-node-gather-daemonset-pjwtm\" (UID: \"8db0d639-b1e3-498f-a131-73e55c2ff18b\") " pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:06.109493 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.109413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:06.235796 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.235770 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm"] Jul 03 17:40:06.238550 ip-10-0-138-0 kubenswrapper[2578]: W0703 17:40:06.238512 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8db0d639_b1e3_498f_a131_73e55c2ff18b.slice/crio-ba5c49cf3abdceb8c6e4068a06c03c7f69f56b81081ddebea41261a47ee80162 WatchSource:0}: Error finding container ba5c49cf3abdceb8c6e4068a06c03c7f69f56b81081ddebea41261a47ee80162: Status 404 returned error can't find the container with id ba5c49cf3abdceb8c6e4068a06c03c7f69f56b81081ddebea41261a47ee80162 Jul 03 17:40:06.452902 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.452867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" event={"ID":"8db0d639-b1e3-498f-a131-73e55c2ff18b","Type":"ContainerStarted","Data":"d1a888ca01e44964305c2370bcc05d9650e48e1d7c8206852869fdbcf92d6044"} Jul 03 17:40:06.453074 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.452920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" event={"ID":"8db0d639-b1e3-498f-a131-73e55c2ff18b","Type":"ContainerStarted","Data":"ba5c49cf3abdceb8c6e4068a06c03c7f69f56b81081ddebea41261a47ee80162"} Jul 03 17:40:06.453074 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.452976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:06.469204 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.469159 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" podStartSLOduration=1.4691446799999999 podStartE2EDuration="1.46914468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 17:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 17:40:06.468074451 +0000 UTC m=+339.162171644" watchObservedRunningTime="2026-07-03 17:40:06.46914468 +0000 UTC m=+339.163241898" Jul 03 17:40:06.496358 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.496331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq7c4_6a22761b-3636-4372-b04f-c95b3e85b058/dns/0.log" Jul 03 17:40:06.518461 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.518442 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq7c4_6a22761b-3636-4372-b04f-c95b3e85b058/kube-rbac-proxy/0.log" Jul 03 17:40:06.645072 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:06.645046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xp8nd_81fa9c97-5e51-43a6-a391-e452a7270939/dns-node-resolver/0.log" Jul 03 17:40:07.034567 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:07.034540 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-92dhm_8a3cd672-8715-4970-b492-8aa397244b58/node-ca/0.log" Jul 03 17:40:07.701989 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:07.701950 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5555d8fdbc-tcw65_679c3f30-5d00-4a89-a634-0443fec05d76/router/0.log" Jul 03 17:40:08.047613 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:08.047536 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xj6xb_f2c2ebb3-a9ce-45a9-b0ee-dc5a06ba8bc9/serve-healthcheck-canary/0.log" Jul 03 17:40:08.519425 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:08.519396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvjfl_53b055a8-caea-4031-aa33-ec66579bdeb4/kube-rbac-proxy/0.log" Jul 03 17:40:08.542098 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:08.542072 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvjfl_53b055a8-caea-4031-aa33-ec66579bdeb4/exporter/0.log" Jul 03 17:40:08.563313 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:08.563288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvjfl_53b055a8-caea-4031-aa33-ec66579bdeb4/extractor/0.log" Jul 03 17:40:12.324009 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:12.323974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nfd4l_3149dad8-130d-4375-bfe5-db6a6fbb8929/migrator/0.log" Jul 03 17:40:12.342672 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:12.342646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nfd4l_3149dad8-130d-4375-bfe5-db6a6fbb8929/graceful-termination/0.log" Jul 03 17:40:12.467505 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:12.467475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bfd2b/perf-node-gather-daemonset-pjwtm" Jul 03 17:40:13.682247 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.682216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/kube-multus-additional-cni-plugins/0.log" Jul 03 17:40:13.703808 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.703785 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/egress-router-binary-copy/0.log" Jul 03 17:40:13.724916 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.724891 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/cni-plugins/0.log" Jul 03 17:40:13.743940 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.743918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/bond-cni-plugin/0.log" Jul 03 17:40:13.762830 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.762807 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/routeoverride-cni/0.log" Jul 03 17:40:13.780308 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.780281 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/whereabouts-cni-bincopy/0.log" Jul 03 17:40:13.800671 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.800650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lzqst_af800938-5641-450a-a2ef-968ef7b2da35/whereabouts-cni/0.log" Jul 03 17:40:13.828001 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.827978 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kd72l_bc783b3a-aa43-4e34-a521-70e25162351d/kube-multus/0.log" Jul 03 17:40:13.905118 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.905093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2ng2c_d6d41ac2-bf75-46e8-b376-57d526a52d19/network-metrics-daemon/0.log" Jul 03 17:40:13.924476 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:13.924447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2ng2c_d6d41ac2-bf75-46e8-b376-57d526a52d19/kube-rbac-proxy/0.log" Jul 03 17:40:15.175576 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.175515 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-controller/0.log" Jul 03 17:40:15.202930 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.202820 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/1.log" Jul 03 17:40:15.202930 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.202824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovn-acl-logging/0.log" Jul 03 17:40:15.222311 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.222283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/kube-rbac-proxy-node/0.log" Jul 03 17:40:15.244833 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.244810 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 17:40:15.270403 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.270363 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/northd/0.log" Jul 03 17:40:15.289707 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.289686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/nbdb/0.log" Jul 03 17:40:15.311977 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.311952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/sbdb/0.log" Jul 03 17:40:15.350090 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:15.350065 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-99dht_67e8600c-85d3-4436-bda9-10b6bb95df79/ovnkube-controller/0.log" Jul 03 17:40:16.549629 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:16.549604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6jg9x_da70a016-6966-4648-a644-261f0b8dffaa/network-check-target-container/0.log" Jul 03 17:40:17.426265 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:17.426206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-84w4m_302d619f-caca-4572-9e45-2f8aae87ae63/iptables-alerter/0.log" Jul 03 17:40:18.021293 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:18.021260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4pkdv_fc6e7c1f-d9cb-4a75-ba14-46cc6729317a/tuned/0.log" Jul 03 17:40:19.646427 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:19.646400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-9576t_4eb0abde-e23c-4476-aec9-e3516ed2f8de/cluster-samples-operator/0.log" Jul 03 17:40:19.661999 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:19.661975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-9576t_4eb0abde-e23c-4476-aec9-e3516ed2f8de/cluster-samples-operator-watch/0.log" Jul 03 17:40:21.280447 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:21.280359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzn2c_40c804ed-f896-42a5-9e6f-46794b04ba62/csi-driver/0.log" Jul 03 17:40:21.299762 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:21.299735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzn2c_40c804ed-f896-42a5-9e6f-46794b04ba62/csi-node-driver-registrar/0.log" Jul 03 17:40:21.318306 ip-10-0-138-0 kubenswrapper[2578]: I0703 17:40:21.318284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-mzn2c_40c804ed-f896-42a5-9e6f-46794b04ba62/csi-liveness-probe/0.log"